llama.cpp
llama : respect no_alloc in all memory caches
#31087
Merged

llama : respect no_alloc in all memory caches #31087

ggerganov merged 3 commits into master from gg/memory-no-alloc
ggerganov
ggerganov llama : respect no_alloc in memory caches
426fbc5d
ggerganov llama : TODO: move no_alloc out of llama_hparams
fdd78d07
ggerganov llama : TODO: move no_alloc out of llama_hparams
40eb7a62
ggerganov ggerganov marked this pull request as ready for review 2 days ago
ggerganov ggerganov merged fa3645fe into master 1 day ago
ggerganov ggerganov deleted the gg/memory-no-alloc branch 1 day ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone