llama.cpp
llama : respect no_alloc in all memory caches
#31087
Merged

llama : respect no_alloc in all memory caches #31087

ggerganov merged 3 commits into master from gg/memory-no-alloc
ggerganov
ggerganov llama : respect no_alloc in memory caches
426fbc5d
ggerganov llama : TODO: move no_alloc out of llama_hparams
fdd78d07
ggerganov llama : TODO: move no_alloc out of llama_hparams
40eb7a62
ggerganov ggerganov marked this pull request as ready for review 29 days ago
ggerganov ggerganov merged fa3645fe into master 28 days ago
ggerganov ggerganov deleted the gg/memory-no-alloc branch 28 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone