transformers
[loading][TP] Fix device placement at loading-time, and simplify sharding primitives
#43003
Merged

[loading][TP] Fix device placement at loading-time, and simplify sharding primitives #43003

Cyrilvallez merged 7 commits into main from fix-tp
Cyrilvallez
Cyrilvallez why was it so complicated
a5abcc59
Cyrilvallez device
8c7441b2
HuggingFaceDocBuilderDev
Cyrilvallez simplify
0487c535
Cyrilvallez fix
d9549f54
Cyrilvallez imports
ce7f0cd8
Cyrilvallez simplify quite a bit
91e6c339
Cyrilvallez Cyrilvallez changed the title [loading] Fix TP device placement [TP] Fix TP device placement at loading-time, and simplify sharding primitives 6 days ago
Cyrilvallez Cyrilvallez changed the title [TP] Fix TP device placement at loading-time, and simplify sharding primitives [TP] Fix device placement at loading-time, and simplify sharding primitives 6 days ago
Cyrilvallez fix
efa1cb10
Cyrilvallez Cyrilvallez changed the title [TP] Fix device placement at loading-time, and simplify sharding primitives [loading][TP] Fix device placement at loading-time, and simplify sharding primitives 6 days ago
Cyrilvallez Cyrilvallez merged 5f1c05cf into main 6 days ago
Cyrilvallez Cyrilvallez deleted the fix-tp branch 6 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone