llama.cpp
llama : reduce useless copies when saving session
#8916

Merged

llama : reduce useless copies when saving session #8916

compilade merged 2 commits into master from compilade/faster-session-sizes

llama : avoid useless copies in dummy session writer

dca7ad86

llama : avoid double tensor copy when saving session to buffer

9329953a

compilade added performance

compilade added bugfix

compilade added Review Complexity : Low

slaren approved these changes on 2024-08-07

ggerganov approved these changes on 2024-08-08

compilade merged 345a686d into master 1 year ago

Reviewers

ggerganov

slaren

Assignees

No one assigned

Labels

performance bugfix Review Complexity : Low

Milestone

No milestone