llama.cpp
server : avoid common_batch
#16
Merged

server : avoid common_batch #16

ggerganov
ggerganov server : avoid common_batch
8a23b4a5
ggerganov ggerganov requested a review from ngxson ngxson 1 year ago
coderabbitai
github-actions github-actions added examples
github-actions github-actions added python
github-actions github-actions added server
ngxson
ngxson commented on 2025-03-20
ggerganov server : remove old commented code [no ci]
b8b17327
ggerganov ggerganov force pushed to b8b17327 1 year ago
ngxson
ngxson ngxson merged bd51d63b into xsn/private_batch_api 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone