text-generation-inference
feat: prefer latest outlines core and compile grammar in router
#3340
Open

feat: prefer latest outlines core and compile grammar in router #3340

drbh wants to merge 11 commits into main from compile-grammar-in-router
drbh
drbh drbh marked this pull request as draft 35 days ago
drbh feat: prefer latest outlines core and compile grammar in router
2e72daa2
drbh drbh force pushed from 697d14be to 2e72daa2 30 days ago
drbh fix: bump outline crate hash and remove debug log
433abf11
drbh fix: clippy cleanups
e42b430f
drbh fix: version pins for amd, intel and neuron
93a821a2
drbh fix: adjust flaky tests and amd dockerfile tweaks
9f4283f1
drbh fix: adjust aiter install on amd docker
68398dbb
drbh fix: removed unsused vocab population comment
71450d3e
drbh fix: adjust typer for neuron cli
dded0cdc
drbh fix: bump test timeout
d3d4f7a5
drbh fix: avoid flaky test for dev and update neuron deps
5a34147f
drbh fix: avoid gaudi until harware is available
71d59878

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone