Add native FSDP2 module + migration #46707
3outeille
merged
53 commits into
main
from
split/a-pr-2-fsdp-module
add distributed config
799ac94d
Add native FSDP2 module and migrate FSDP imports (Phase A PR-2).
22d4b52b
linting
4bfd1a64
unecessary
9487bdda
copyright edit
588884e6
revert
8cc48a06
Merge branch 'main' into split/a-pr-1-distributed-config
5bbc7960
Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp…
6fd78131
fix
79457b3f
fix
f3e80210
Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp…
acacae84
Merge branch 'main' into split/a-pr-1-distributed-config
54c1f4e5
Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp…
f219c74c
remove redundant test file
ea8243f8
Merge branch 'main' into split/a-pr-1-distributed-config
db31b043
Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp…
4d840dcc
Update src/transformers/distributed/fsdp.py
c384fcdc
avoid looping, just look at dict
96258163
expand_fsdp returns reshard_targets, no_reshard_targets right away
59bcec56
better _resolve_tied_embed_lm_head_plan
ebf3585c
cleaning
e9693251
ruff
2376965e
Merge branch 'main' into split/a-pr-1-distributed-config
d8301145
Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp…
a44f81f2
more robust detection of embed and lm_head
0f62c45e
Merge branch 'split/a-pr-2-fsdp-module' of https://github.com/hugging…
020f7d3f
cleaning
da302ade
ruff
dfc665cd
typo
446fd6e9
cleaner
5aeaff74
cleaner
819ff149
Merge branch 'main' into split/a-pr-1-distributed-config
413d775c
Merge branch 'split/a-pr-1-distributed-config' into split/a-pr-2-fsdp…
7bc37223
Base automatically changed from
split/a-pr-1-distributed-config
to
main
15 days ago
Merge branch 'main' into split/a-pr-2-fsdp-module
f8f27ffd
Merge branch 'main' into split/a-pr-2-fsdp-module
ce2f0019
Merge branch 'main' into split/a-pr-2-fsdp-module
ec87fff3
Merge branch 'main' into split/a-pr-2-fsdp-module
6e156fd4
Merge branch 'main' into split/a-pr-2-fsdp-module
606df0ac
Merge branch 'main' into split/a-pr-2-fsdp-module
c4aa4b70
Merge branch 'main' into split/a-pr-2-fsdp-module
c5ad67b5
Merge branch 'main' into split/a-pr-2-fsdp-module
04c124ed
Merge branch 'main' into split/a-pr-2-fsdp-module
8b57aa41
Merge branch 'main' into split/a-pr-2-fsdp-module
dd1000bb
expand_fsdp_plan iterate over modules
5c95559e
Merge branch 'split/a-pr-2-fsdp-module' of https://github.com/hugging…
00a11b6a
comment about tie embedding
e4613e67
add comment tied embedding
d558f999
ArthurZucker
approved these changes
on 2026-07-06
Merge branch 'main' into split/a-pr-2-fsdp-module
1541674d
Merge branch 'main' into split/a-pr-2-fsdp-module
9fae1b40
Merge branch 'main' into split/a-pr-2-fsdp-module
0b4d1e06
Merge branch 'main' into split/a-pr-2-fsdp-module
ee2ce293
Merge branch 'main' into split/a-pr-2-fsdp-module
bf22ce14
Merge branch 'main' into split/a-pr-2-fsdp-module
40ae938f
Login to write a write a comment.
Login via GitHub