PR #49256 FSDP x TP Saving / Loading, Optimizer

FSDP x TP Saving / Loading, Optimizer #49256

michaelbenayoun merged 5 commits into huggingface:main from michaelbenayoun:fsdp_tp_saving_optimizer

3outeille requested a review from

3outeille 36 days ago

3outeille removed review request from

3outeille 36 days ago

3outeille requested a review from

ArthurZucker 36 days ago

3outeille requested a review from

3outeille 36 days ago

3outeille approved these changes on 2026-10-06

3outeille commented on 2026-10-13

michaelbenayoun force pushed from c123682b to 49149c74 28 days ago

michaelbenayoun force pushed from 82833279 to 1d0cf8af 28 days ago

michaelbenayoun force pushed from 1d0cf8af to 9f48d039 27 days ago

michaelbenayoun force pushed from 4b9d8eb6 to c6318f2b 27 days ago

ArthurZucker approved these changes on 2026-10-15

michaelbenayoun changed the base branch from fsdp_tp_saving to main 26 days ago

Revert "refactor: restore optimizer changes for stacking"

ea85e26d

fix: update guards as they now return booleans

a88a7845

feat: use reverse logic in load_optimizer_distributed

7bbb4d02

refactor: rename helper function

4fd1b944

style: ruff

970bb38d

michaelbenayoun force pushed from c6318f2b to 970bb38d 26 days ago

michaelbenayoun merged e62ee803 into main 26 days ago

michaelbenayoun deleted the fsdp_tp_saving_optimizer branch 26 days ago

Reviewers

ArthurZucker

3outeille

Assignees

No one assigned

Labels

None yet

Milestone

No milestone