text-generation-inference
7dbaf9e9 - fix: correctly index into mask when applying grammar (#1618)

Commit
1 year ago
fix: correctly index into mask when applying grammar (#1618) This PR fixes how the grammar mask is index when generating text and adds a new test to ensure the grammars work with non flash models
Author
Parents
Loading