transformers
TP refactor for FSDP + TP integration
#45028
Open
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
2
Changes
View On
GitHub
TP refactor for FSDP + TP integration
#45028
3outeille
wants to merge 2 commits into
fsdp-core-model-loading
from
refactor-tp-dtensor
FSDP + TP now works but that requires us to rely on dtensor TP
d48fcc7e
Merge fsdp-core-model-loading into refactor-tp-dtensor
9b6695a4
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub