text-generation-inference
7dbaf9e9
- fix: correctly index into mask when applying grammar (#1618)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
fix: correctly index into mask when applying grammar (#1618) This PR fixes how the grammar mask is index when generating text and adds a new test to ensure the grammars work with non flash models
References
#1618 - fix: correctly index into mask when applying grammar
Author
drbh
Parents
7e087513
Loading