PR #45219 Add MoE to Gemma4 TP plan

Add MoE to Gemma4 TP plan #45219

Cyrilvallez merged 2 commits into huggingface:main from sywangyi:reduce_memory_gemma4

reduce memory for gemma4 moe model in tp

b6dc1524

Rocketknight1 dismissed these changes on 2026-04-08

Rocketknight1 enabled auto-merge 103 days ago

Cyrilvallez dismissed their stale review 103 days ago

TP plan not correct

Cyrilvallez changed the title ~~reduce memory for gemma4 moe model in tp~~ Improve Gemma4 TP plan 103 days ago

Cyrilvallez changed the title ~~Improve Gemma4 TP plan~~ Add MoE to Gemma4 TP plan 103 days ago

Cyrilvallez approved these changes on 2026-04-08

Merge branch 'main' into reduce_memory_gemma4

83d4a9f0

Cyrilvallez merged 7f6cc4b3 into main 103 days ago

sywangyi deleted the reduce_memory_gemma4 branch 62 days ago

Reviewers

Cyrilvallez

Rocketknight1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone