text-generation-inference
fix: handle batches with and without grammars
#1676
Merged

fix: handle batches with and without grammars #1676

drbh
drbh fix: handle batches with and without grammars
0cd04fe4
drbh drbh requested a review from OlivierDehaene OlivierDehaene 1 year ago
drbh drbh requested a review from Narsil Narsil 1 year ago
OlivierDehaene
OlivierDehaene approved these changes on 2024-03-28
drbh drbh merged 762dbf3f into main 1 year ago
drbh drbh deleted the handle-concurrent-mixed-grammar-requests branch 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone