transformers
TP refactor for FSDP + TP integration
#45028
Open

TP refactor for FSDP + TP integration #45028

3outeille wants to merge 2 commits into fsdp-core-model-loading from refactor-tp-dtensor
3outeille
3outeille FSDP + TP now works but that requires us to rely on dtensor TP
d48fcc7e
3outeille Merge fsdp-core-model-loading into refactor-tp-dtensor
9b6695a4
HuggingFaceDocBuilderDev
github-actions

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone