text-generation-inference

a6c18c39 - feat(server): use cuda graph in logits warping (#302)