llama : add option to override model tensor buffers #11397
slaren
merged
9 commits into
master
from
sl/custom-tensor-offload
llama : add option to override tensor buffers
f07c2ec5
slaren
changed the title 
Merge remote-tracking branch 'origin/master' into sl/custom-tensor-of…
bb6b97e7
add regex support
6c8d01a8
ggml : fix possible underflow in ggml_nbytes
538f6093
rebuild buft list on every call
8770ffa6
Merge remote-tracking branch 'origin/master' into sl/custom-tensor-of…
2e54433a
wip
ab2d43a9
Merge remote-tracking branch 'origin/master' into sl/custom-tensor-of…
6693b0af
disable pipeline parallelism when there are tensor overrides
2e4e8b13
ggerganov
approved these changes
on 2025-04-02
Login to write a write a comment.
Login via GitHub