llama.cpp
47e37dd9
- grammars: reuse new_stacks
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
grammars: reuse new_stacks
References
#6609 - grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses)
Author
Olivier Chafik
Parents
3732ad9c
Loading