llama.cpp
b2debf65
- parallel : add disabled experimental batch chunking in powers of two
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
parallel : add disabled experimental batch chunking in powers of two
References
#3228 - llama : custom attention mask + parallel decoding + no context swaps
Author
ggerganov
Parents
ded9b43c
Loading