transformers
unifying device_mesh init to enable PP + TP inference
#48155

Merged

unifying device_mesh init to enable PP + TP inference #48155

3outeille merged 8 commits into main from transformer_2D_pp_tp

3outeille requested a review from

ArthurZucker 57 days ago

ArthurZucker commented on 2026-08-25

Base automatically changed from pp_inference to main 53 days ago

3outeille changed the title ~~PP + TP inference~~ unifying device_mesh init to enable PP + TP inference 36 days ago

3outeille force pushed from 50d6e853 to a8d433a9 36 days ago

3outeille requested a review from

ArthurZucker 36 days ago

3outeille commented on 2026-09-11

ArthurZucker approved these changes on 2026-09-12

merge conflicts

b439ad9c

remove unused device_mesh

0d4f20d1

revert merge conflicts

462ab97f

revert

6ee79922

lint

e5ab9b06

add vlm support

ef023791

Revert "add vlm support"

c57c7af4

Update src/transformers/distributed/configuration_utils.py

91fb7d3a

3outeille force pushed from 587de7b7 to 91fb7d3a 35 days ago

3outeille merged 5474a55e into main 35 days ago

3outeille deleted the transformer_2D_pp_tp branch 35 days ago

Reviewers

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone