text-generation-inference

feat(server): use cuda graph in logits warping

#302

Merged