text-generation-inference

c9d68945 - Prepare for release 3.1.0 (#2972)

Prepare for release 3.1.0 (#2972) * Prepare for release 3.1.0 * Back on main flake. * Fixing stuff. * Upgrade to moe-kernels 0.8.2 for Hip support. * Deactivating the flaky test.