transformers
from_pretrained distributed refactor (FSDP2 + TP)
#44996
Open

from_pretrained distributed refactor (FSDP2 + TP) #44996

3outeille wants to merge 7 commits into fsdp-core-model-loading from distributed-refactor
3outeille
HuggingFaceDocBuilderDev
3outeille 3outeille force pushed from 1436e314 to 4972eaea 14 hours ago
3outeille 3outeille changed the base branch from fsdp-vs-ddp to fsdp-core-model-loading 14 hours ago
3outeille 3outeille force pushed from 4972eaea to 091eaa2f 14 hours ago
3outeille 3outeille marked this pull request as ready for review 13 hours ago
3outeille feat: from_pretrained distributed refactor (FSDP2 + TP via Distribute…
a05514cd
3outeille Convert DistributedConig to dict for JSON serialization
c758c595
3outeille 3outeille force pushed from 502a09fe to c758c595 13 hours ago
3outeille some fixes
2a1a086b
3outeille linting
95a64fc6
3outeille linting
22c75c2d
3outeille freaking linting again
9ffd008c
github-actions
3outeille Merge fsdp-core-model-loading (ruff fixes) into distributed-refactor
18e232c4
github-actions
amitmodi

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone