llama.cpp
ebf57258 - convert : yield Mamba2Model/GraniteMoeModel modify_tensors (#19157)

Commit
14 days ago
convert : yield Mamba2Model/GraniteMoeModel modify_tensors (#19157) * convert : yield Mamba2Model/GraniteMoeModel modify_tensors This commit updates the `GraniteHybridModel` class' modify_tensors function to properly delegate to `Mamba2Model.modify_tensors` and `GraniteMoeModel.modify_tensors` using 'yield from' instead of 'return'. The motivation for this is that modify_tensors is a generator function (it uses 'yield from'), but the two calls above use return statements but don't yield anything which means that the the caller of this function will not receive any yielded values from it. And this causes layer tensors to be silently dropped during conversion.
Author
Parents
Loading