vllm
[Bugfix] Fix Granite 3.0 MoE model loading
#12446
Merged

[Bugfix] Fix Granite 3.0 MoE model loading #12446

DarkLight1337
DarkLight1337 [Bugfix] Fix Granite 3.0 MoE model loading
f51a1584
DarkLight1337 DarkLight1337 added ready
DarkLight1337 DarkLight1337 requested a review from youkaichao youkaichao 328 days ago
github-actions
DarkLight1337 DarkLight1337 requested a review from njhill njhill 328 days ago
jeejeelee
jeejeelee approved these changes on 2025-01-26
mgoin
mgoin approved these changes on 2025-01-26
simon-mo simon-mo merged 5204ff5c into main 327 days ago
DarkLight1337 DarkLight1337 deleted the fix-granite-moe branch 327 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone