llama.cpp
llama: Add option to merge gate and exp weights
#19139

Merged

llama: Add option to merge gate and exp weights #19139

am17an merged 8 commits into ggml-org:master from am17an:exp_weight_merge_glm

am17an requested a review from

CISC 133 days ago

github-actions added model

github-actions added python

CISC commented on 2026-01-27

ngxson commented on 2026-01-27

am17an force pushed from c846c0b4 to 93c09b07 133 days ago

ngxson commented on 2026-01-27

llama: Add option to merge gate and exp weights

c9b344e3

Update convert_hf_to_gguf.py

0cdf226f

Update convert_hf_to_gguf.py

c0f2dfa5

update constants.py

ec6537c0

add gate_up for the all MoE models

f327a49d

convert: simplify merge tensor condition

f1dc97cc

update constants.py

c7fd7770

reduce number of models, add create_tensor_gate_up helper

28fac13e

am17an force pushed from 362bff97 to 28fac13e 104 days ago

ngxson approved these changes on 2026-02-26

am17an merged b68d7516 into master 103 days ago

am17an deleted the exp_weight_merge_glm branch 103 days ago

Reviewers

ngxson

CISC

Assignees

No one assigned

Labels

model python

Milestone

No milestone