transformers
handle transpose during model loading with TP (Qwen3-VL-MoE)
#48373

Open

handle transpose during model loading with TP (Qwen3-VL-MoE) #48373

3outeille wants to merge 18 commits into main from qwen3_vl_moe_tp_plan

Fix Native TP expert and lm_head sharding for Qwen3-VL-MoE

8cb29882

adapt checkpoint weights layout to transformers layout with conversion

39064711

revert

8491c808

cleaner refacto

818bd0d4

cleaning

a9f6dea7

cleaner

608a7b34

3outeille changed the title ~~Fix Native TP expert and lm_head sharding for Qwen3-VL-MoE~~ handle transpose during model loading with TP (Qwen3-VL-MoE) 23 days ago

guarding

0ae45659

3outeille marked this pull request as ready for review 23 days ago

Merge branch 'main' into qwen3_vl_moe_tp_plan

ccd1bc3e

github-actions requested a review from

Rocketknight1 23 days ago

github-actions requested a review from

ArthurZucker 23 days ago

better explanation

8fe376c4

t push

0c6a4258

extra check dims

5070091e

Merge branch 'main' into qwen3_vl_moe_tp_plan

0139149b

3outeille removed review request from

Rocketknight1 23 days ago

fix

12e21950

Merge branch 'qwen3_vl_moe_tp_plan' of github.com:huggingface/transfo…

4d84c699

Merge branch 'main' into qwen3_vl_moe_tp_plan

0826c37b

3outeille enabled auto-merge 18 days ago

disabled auto-merge 18 days ago
Manually disabled by user

Merge branch 'main' into qwen3_vl_moe_tp_plan

298ffa4d

Merge branch 'main' into qwen3_vl_moe_tp_plan

86fc3945

Merge branch 'main' into qwen3_vl_moe_tp_plan

6fbcb300

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers handle transpose during model loading with TP (Qwen3-VL-MoE) #48373 Open

handle transpose during model loading with TP (Qwen3-VL-MoE) #48373

transformers
handle transpose during model loading with TP (Qwen3-VL-MoE)
#48373

Open