llama.cpp
mtmd: add batching API
#24384
Merged

mtmd: add batching API #24384

ngxson merged 14 commits into ggml-org:master from ngxson:xsn/mtmd_batch_api
ngxson
ngxson mtmd: add batching API
b62c3051
github-actions github-actions added examples
github-actions github-actions added server
sfallah
ngxson wip
111d3f17
ngxson Merge branch 'master' into xsn/mtmd_batch_api
eb2dab2f
ngxson first working version (gemma4v)
f77cfd73
ngxson add arg
190bef3b
ngxson nits
a773d7b8
ngxson wire up support_batch()
3eecd674
ngxson fix 0.0 output embd
7a22484c
ngxson fix audio
2dd581ae
ngxson nits
de656cc3
ngxson refactor a bit
67d43350
ngxson nits
0d6bc77d
ngxson ngxson marked this pull request as ready for review 28 days ago
ngxson ngxson requested a review 28 days ago
ngxson ngxson requested a review 28 days ago
ngxson ngxson requested a review 28 days ago
ngxson
sfallah
ngxson
sfallah
ngxson
sfallah
ngxson
ngxson fix non-batching case
b3a5ca93
ngxson
sfallah
ngxson
sfallah
sfallah
ngxson
ngxson fix comment
4cf77599
ngxson
ngxson ngxson merged e37abd6b into master 27 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone