pytorch-lightning
Rudimentary support for weight averaging (EMA) with FSDP
#21414

Open

Rudimentary support for weight averaging (EMA) with FSDP #21414

senarvi wants to merge 1 commit into Lightning-AI:master from senarvi:weight-averaging-fsdp

senarvi requested a review from

lantiga 250 days ago

senarvi requested a review from

tchaton 250 days ago

senarvi requested a review from

justusschock 250 days ago

senarvi requested a review from

ethanwharris 250 days ago

github-actions added pl

github-actions added has conflicts

senarvi force pushed from d7955925 to 241a95f6 250 days ago

github-actions removed has conflicts

bhimrazy requested a review from

deependujha 248 days ago

senarvi force pushed from d1f40af3 to 675ba325 248 days ago

github-actions added docs

senarvi force pushed from 675ba325 to aff4ce9c 248 days ago

github-actions added has conflicts

senarvi force pushed from aff4ce9c to 5a75ceb8 227 days ago

github-actions removed has conflicts

github-actions added has conflicts

senarvi force pushed from 5a75ceb8 to c25847da 162 days ago

github-actions removed has conflicts

Summon all model parameters before updating the average model, when u…

c129bc80

senarvi force pushed from c25847da to c129bc80 147 days ago

github-actions added has conflicts

Reviewers

lantiga

tchaton

justusschock

ethanwharris

deependujha

Assignees

No one assigned

Labels

docs has conflicts pl

Milestone

No milestone