transformers
Add FSDP CI and end-to-end FSDP tests + save fsdp
#47357
Merged
Overview
Commits
40
Changes
View On GitHub

Add FSDP CI and end-to-end FSDP tests + save fsdp #47357

3outeille merged 40 commits into main from split/a-pr-4-2-fsdp-tests-ci
3outeille
3outeille Add distributed runtime utils and DistributedMixin (FSDP orchestratio…
e764cebd
3outeille Wire DistributedConfig through from_pretrained and save_pretrained (F…
61362b74
3outeille Add FSDP CI and end-to-end FSDP tests (FSDP orchestration 3/3).
eb34d37f
3outeille addd ep_plan
b866f008
3outeille Merge branch 'split/a-pr-4-1-distributed-runtime' into split/a-pr-4-2…
3da6fb9a
3outeille Merge branch 'split/a-pr-4-2-orchestration' into split/a-pr-4-3-fsdp-…
ca8d0370
3outeille restore validate module
b3f45385
3outeille Wire DistributedConfig through from_pretrained and save_pretrained.
b1fb1b93
3outeille revert
1bf32cc4
3outeille Merge branch 'split/a-pr-4-1-distributed-runtime' into split/a-pr-4-2…
1620c0f2
3outeille Merge branch 'split/a-pr-4-2-orchestration' into split/a-pr-4-3-fsdp-…
fe0dcf7d
3outeille inline distribute_model
e52fda3f
3outeille revert
71dde8aa
3outeille remove saving/loading
4e23dbf1
3outeille leaner mixin
5742a2ef
3outeille downgrade torch version guarding
5c81035d
3outeille remove
004354f8
3outeille linting
6d03414a
3outeille Merge branch 'split/a-pr-4-1-distributed-runtime' into split/a-pr-4-3…
450987f3
3outeille 3outeille changed the title Wire DistributedConfig through from_pretrained and save_pretrained (F… Add FSDP CI and end-to-end FSDP tests + save/load fsdp 65 days ago
3outeille revert
47d85adb
3outeille Merge branch 'split/a-pr-4-2-fsdp-tests-ci' of https://github.com/hug…
c577f337
HuggingFaceDocBuilderDev
3outeille revert
b319d6ac
3outeille post_init() parallel plan move to mixin
eb9a081e
3outeille Merge branch 'split/a-pr-4-1-distributed-runtime' into split/a-pr-4-2…
d5358f3e
3outeille revert tp mixin
9a783c8c
3outeille Merge branch 'split/a-pr-4-1-distributed-runtime' into split/a-pr-4-2…
0448e72f
3outeille add save/load
259bff43
3outeille Merge branch 'main' into split/a-pr-4-1-distributed-runtime
b15b63e1
3outeille Merge branch 'main' into split/a-pr-4-1-distributed-runtime
17d611b4
3outeille Merge branch 'main' into split/a-pr-4-1-distributed-runtime
7fe841b7
3outeille Merge branch 'split/a-pr-4-1-distributed-runtime' into split/a-pr-4-2…
5f9b5ab2
Base automatically changed from split/a-pr-4-1-distributed-runtime to main 60 days ago
3outeille Merge branch 'main' into split/a-pr-4-2-fsdp-tests-ci
b95be32b
3outeille only FSDP save/load for now
d6257574
3outeille Merge branch 'split/a-pr-4-2-fsdp-tests-ci' of https://github.com/hug…
9e810e40
3outeille revert
049b89c0
3outeille 3outeille marked this pull request as ready for review 60 days ago
github-actions github-actions requested a review from Rocketknight1 Rocketknight1 60 days ago
github-actions github-actions requested a review from ydshieh ydshieh 60 days ago
3outeille 3outeille removed review request from ydshieh ydshieh 60 days ago
3outeille 3outeille removed review request from Rocketknight1 Rocketknight1 60 days ago
3outeille 3outeille changed the title Add FSDP CI and end-to-end FSDP tests + save/load fsdp Add FSDP CI and end-to-end FSDP tests + save fsdp 60 days ago
3outeille refactor
6b35d0e3
3outeille 3outeille requested a review from ArthurZucker ArthurZucker 59 days ago
3outeille Merge branch 'main' into split/a-pr-4-2-fsdp-tests-ci
047bd41d
3outeille Merge branch 'main' into split/a-pr-4-2-fsdp-tests-ci
8c96054e
ArthurZucker
ArthurZucker commented on 2026-07-23
ArthurZucker
ArthurZucker approved these changes on 2026-07-23
3outeille inline
4636f273
3outeille Merge branch 'split/a-pr-4-2-fsdp-tests-ci' of https://github.com/hug…
4012f87a
github-actions
3outeille
github-actions
github-actions
github-actions
github-actions
3outeille 3outeille merged 9de8a4d2 into main 58 days ago
3outeille 3outeille deleted the split/a-pr-4-2-fsdp-tests-ci branch 58 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum