transformers
Refactor core_model_loading to support FSDP shard-on-read loading
#44974
Open
Open
Refactor core_model_loading to support FSDP shard-on-read loading #44974
3outeille
wants to merge
6 commits into
fsdp-vs-ddp
from
fsdp-core-model-loading
Refactor core_model_loading to support FSDP shard-on-read loading
4b2a9216
Merge fsdp-vs-ddp into fsdp-core-model-loading
c9f30d9f
Merge fsdp-vs-ddp (ruff fixes) into fsdp-core-model-loading
b7c3dc5c
linting
dfdfbdd9
from_pretrained distributed refactor (FSDP2 + TP) (#44996)
187ee5d4
DTensor-based TP + FSDP2 shard-on-read composability
607cc114
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub