text-generation-inference

5ce89059 - feat(server): pre-allocate past key values for flash causal LM (#412)