text-generation-inference

7a48a847 - Using an enum for flash backens (paged/flashdecoding/flashinfer) (#2385)

Using an enum for flash backens (paged/flashdecoding/flashinfer) (#2385) * Using an enum for flash backens (paged/flashdecoding/flashinfer) * Early exit on server too. * Clippy. * Fix clippy and fmt.