llama.cpp
llama : auto-batch preparation
#13845
Merged

llama : auto-batch preparation #13845

ggerganov merged 2 commits into master from gg/auto-batch
ggerganov
github-actions github-actions added examples
github-actions github-actions added server
ggerganov ggerganov force pushed from 1adcd4b3 to ca69f329 103 days ago
ggerganov ggerganov marked this pull request as ready for review 103 days ago
ggerganov ggerganov requested a review from ngxson ngxson 103 days ago
compilade
ggerganov
slaren
Base automatically changed from gg/kv-cache-simplify-part3 to master 103 days ago
ggerganov llama : auto-batch
a0591616
ggerganov ggerganov force pushed from ca69f329 to a0591616 103 days ago
ggerganov ggerganov changed the title llama : auto-batch llama : auto-batch preparation 103 days ago
ggerganov
ggerganov context : simplify if branching
b980b837
ggerganov ggerganov merged 3f55f781 into master 103 days ago
ggerganov ggerganov deleted the gg/auto-batch branch 103 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone