text-generation-inference

0a609731 - Fixing the batching tokenization in flash causal lm.