text-generation-inference

1539d3cb - feat(router): Remove second lock from batcher hot path (#27)