PR #4142 [FSDP2] Shard eagerly initialized optimizer state

[FSDP2] Shard eagerly initialized optimizer state #4142

sdjasj wants to merge 1 commit into huggingface:main from sdjasj:agent/fix-fsdp2-adagrad-state

Shard eager optimizer state with FSDP2 parameters

1762e3f6

sdjasj marked this pull request as ready for review 4 days ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone