transformers
FSDP2 native support in transformers
#44083
Closed
Overview
Commits
16
Changes
View On GitHub

FSDP2 native support in transformers #44083

3outeille wants to merge 16 commits into main from fsdp-vs-ddp
3outeille
3outeille 3outeille changed the title Add distributed training CI job to CircleCI configuration FSDP native support in transformers 104 days ago
HuggingFaceDocBuilderDev
3outeille 3outeille changed the base branch from v5-distributed-training-ci to main 81 days ago
3outeille 3outeille marked this pull request as ready for review 81 days ago
github-actions github-actions requested a review from SunMarc SunMarc 81 days ago
github-actions github-actions requested a review from ydshieh ydshieh 81 days ago
SunMarc
SunMarc commented on 2026-03-11
cursor
cursor commented on 2026-03-12
cursor
cursor commented on 2026-03-12
3outeille 3outeille changed the title FSDP native support in transformers FSDP2 native support in transformers 74 days ago
3outeille 3outeille requested a review from ArthurZucker ArthurZucker 74 days ago
3outeille 3outeille requested a review from SunMarc SunMarc 74 days ago
3outeille 3outeille removed review request from ydshieh ydshieh 74 days ago
ArthurZucker
ArthurZucker commented on 2026-03-19
kashif
3outeille init
7c843391
3outeille Merge branch 'main' into distributed_api
69bc48e1
3outeille 3outeille changed the base branch from main to distributed_api 67 days ago
ArthurZucker ArthurZucker changed the base branch from distributed_api to main 52 days ago
3outeille 3outeille changed the base branch from main to distributed_api 48 days ago
3outeille Merge branch 'main' into distributed_api
b7ec958e
3outeille Merge remote-tracking branch 'origin/main' into distributed_api
45a01a54
3outeille FSDP2 (fully_shard) integration
a5c25548
3outeille 3outeille force pushed from 978ac872 to a5c25548 48 days ago
3outeille Merge branch 'main' into distributed_api
eeefc9e8
3outeille Merge branch 'distributed_api' into fsdp-vs-ddp
90384750
3outeille revert some files
abfd57ee
3outeille Merge branch 'fsdp-vs-ddp' of https://github.com/huggingface/transfor…
23a2c059
3outeille Add distributed training scripts
c33873e7
3outeille Merge branch 'distributed_api' of https://github.com/huggingface/tran…
e7832312
3outeille Remove train_fsdp_tp_torchtitan_style.py
34db8405
3outeille unify the utils for fsdp
6f9e2b67
3outeille Merge branch 'distributed_api' into fsdp-vs-ddp
5e017cf5
github-actions
3outeille 3outeille force pushed from 864e9fa4 to 7f6cd3d8 48 days ago
3outeille Fix CI: re-export moved FSDP utils + remove stale type: ignore
37dcc14d
3outeille 3outeille force pushed from 7f6cd3d8 to 37dcc14d 47 days ago
3outeille 3outeille changed the base branch from distributed_api to main 34 days ago
3outeille Merge branch 'main' into fsdp-vs-ddp
10c6563e
github-actions
3outeille 3outeille closed this 13 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum