llama.cpp
960d628f - mamba2: remove hardcoded 2x expansion factor and invalid d_inner % d_state check (#23082)

Commit
30 days ago
mamba2: remove hardcoded 2x expansion factor and invalid d_inner % d_state check (#23082) * mamba2: remove hardcoded 2x expansion factor, support any expand value * mamba2: remove invalid d_inner %% d_state check (unrelated parameters) * Update convert_hf_to_gguf.py: make expand optional with default 2 Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com> * mamba2: apply expand fix to refactored conversion/mamba.py * also check for mamba_expand --------- Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com> Co-authored-by: Sigbjørn Skjæret <1629204+CISC@users.noreply.github.com>
Author
Parents
Loading