pytorch-lightning
(4/n) Support 2D Parallelism - Loading optimizer states correctly
#19872

Merged

(4/n) Support 2D Parallelism - Loading optimizer states correctly #19872

lantiga merged 3 commits into master from feature/tp-full-optim-load

awaelchli added feature

awaelchli added checkpointing

github-actions removed feature

github-actions removed checkpointing

github-actions added fabric

awaelchli added this to the 2.3 milestone 2 years ago

awaelchli force pushed from 99bc77b4 to 18c85441 2 years ago

awaelchli added feature

awaelchli added checkpointing

awaelchli marked this pull request as ready for review 2 years ago

awaelchli requested a review from

carmocca 2 years ago

awaelchli requested a review from

justusschock 2 years ago

Load optimizer state

dbee485f

awaelchli force pushed from 18c85441 to dbee485f 2 years ago

move to utility

6a7bce55

[pre-commit.ci] auto fixes from pre-commit.com hooks

644fd0a8

justusschock approved these changes on 2024-05-17

lantiga approved these changes on 2024-05-17

lantiga merged 1d0c6aae into master 2 years ago

lantiga deleted the feature/tp-full-optim-load branch 2 years ago

mergify added ready to be merged

Reviewers

justusschock

lantiga

carmocca

Assignees

No one assigned

Labels

feature ready to be merged checkpointing fabric

Milestone

2.3