llama.cpp
server : add SWA checkpoints
#15293
Merged

server : add SWA checkpoints #15293

ggerganov merged 8 commits into master from gg/server-swa-checkpoints
ggerganov
ggerganov server : add SWA checkpoints
96db966b
ggerganov ggerganov requested a review from slaren slaren 127 days ago
github-actions github-actions added examples
github-actions github-actions added server
ggerganov
ggerganov
ggerganov commented on 2025-08-13
slaren
ggerganov cont : server clean-up
487b9223
ggerganov
slaren
ggerganov server : handle state restore fails
5b0d207d
ggerganov llama : add extended llama_state_seq_ API
025af154
ggerganov server : do not make checkpoints if --swa-full
e7d2ecdf
ggerganov ggerganov marked this pull request as ready for review 127 days ago
ggerganov ggerganov requested a review from ngxson ngxson 127 days ago
ggerganov
slaren
slaren commented on 2025-08-14
slaren
slaren commented on 2025-08-14
ggerganov llama : remove flags value for NONE
c2b5cfb7
ggerganov server : configure number of SWA checkpoints with CLI arg
52b775ed
slaren
slaren commented on 2025-08-14
ggerganov args : fix scope of new argument
3d08a656
slaren
slaren approved these changes on 2025-08-14
ggerganov ggerganov merged d32e03f4 into master 127 days ago
ggerganov ggerganov deleted the gg/server-swa-checkpoints branch 127 days ago
ddh0
ggerganov
Marrim
ggerganov

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone