llama.cpp
llama : add option to save memory in device buffers
#22679

Merged

llama : add option to save memory in device buffers #22679

ggerganov merged 2 commits into master from gg/llama-state-buf

llama : add option to save memory in device buffers

4640060c

ggerganov requested a review 53 days ago

ngxson approved these changes on 2026-05-04

ServeurpersoCom approved these changes on 2026-05-04

github-actions added examples

github-actions added server

github-actions added ggml

github-actions added Apple Metal

tests : extend llama-save-load-state

9c6ca18c

ggerganov merged d6e7b033 into master 52 days ago

ggerganov deleted the gg/llama-state-buf branch 52 days ago

Reviewers

ServeurpersoCom

ngxson

Assignees

No one assigned

Labels

examples server ggml Apple Metal

Milestone

No milestone