text-generation-inference

feat(server): pre-allocate past key values for flash causal LM

#412

Merged