vllm
[Bugfix] Support HF sharded weights for Mistral3/Pixtral models
#32673
Merged

[Bugfix] Support HF sharded weights for Mistral3/Pixtral models #32673

ricky-chaoju
ricky-chaoju ricky-chaoju requested a review from patrickvonplaten patrickvonplaten 115 days ago
mergify mergify added bug
gemini-code-assist
gemini-code-assist commented on 2026-01-20
ricky-chaoju fix: support HF sharded weights for Mistral3/Pixtral models
e1942b23
ricky-chaoju ricky-chaoju force pushed to e1942b23 115 days ago
DarkLight1337
ricky-chaoju
DarkLight1337
DarkLight1337 approved these changes on 2026-01-20
DarkLight1337
DarkLight1337 commented on 2026-01-20
ricky-chaoju refactor: use removeprefix for language_model prefix stripping
c067d386
ricky-chaoju ricky-chaoju force pushed to c067d386 115 days ago
DarkLight1337 DarkLight1337 enabled auto-merge (squash) 115 days ago
github-actions github-actions added ready
ricky-chaoju
DarkLight1337
chay1045
chay1045 approved these changes on 2026-01-21
vllm-bot vllm-bot merged f23fb5a7 into main 114 days ago
ricky-chaoju ricky-chaoju deleted the fix/mistral3-sharded-weights-loading branch 113 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone