llama.cpp
c5fc7e34 - llama : add --n-cpu-ffn option (#26622)

Commit
65 days ago
llama : add --n-cpu-ffn option (#26622) * common : dedupe --n-cpu-moe / --spec-draft-n-cpu-moe override loops * common : add --n-cpu-ffn to CPU-offload dense FFN weights of first N layers * common : generalize llm_ffn_block_regex over the FFN regex, drop TODO
Author
Parents
Loading