pytorch-lightning
Rudimentary support for weight averaging (EMA) with FSDP
#21414

Open

Rudimentary support for weight averaging (EMA) with FSDP #21414

senarvi wants to merge 1 commit into Lightning-AI:master from senarvi:weight-averaging-fsdp

senarvi requested a review from

lantiga 3 days ago

senarvi requested a review from

tchaton 3 days ago

senarvi requested a review from

justusschock 3 days ago

senarvi requested a review from

ethanwharris 3 days ago

github-actions added pl

github-actions added has conflicts

senarvi force pushed from d7955925 to 241a95f6 3 days ago

github-actions removed has conflicts

bhimrazy requested a review from

deependujha 1 day ago

senarvi force pushed from d1f40af3 to 675ba325 1 day ago

github-actions added docs

Summon all model parameters before updating the average model, when u…

aff4ce9c

senarvi force pushed from 675ba325 to aff4ce9c 1 day ago

Reviewers

lantiga

tchaton

justusschock

ethanwharris

deependujha

Assignees

No one assigned

Labels

docs pl

Milestone

No milestone