llama.cpp
e37abd6b
- mtmd: add batching API (#24384)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
25 days ago
mtmd: add batching API (#24384) * mtmd: add batching API * wip * first working version (gemma4v) * add arg * nits * wire up support_batch() * fix 0.0 output embd * fix audio * nits * refactor a bit * nits * fix non-batching case * fix comment
References
#24384 - mtmd: add batching API
Author
ngxson
Parents
f58bad41
Loading