pytorch-lightning
(1/n) Support 2D Parallelism
#19846
Merged
Overview
Commits
16
Changes
View On GitHub

(1/n) Support 2D Parallelism #19846

awaelchli merged 16 commits into master from examples/tp
awaelchli
github-actions github-actions added fabric
github-actions github-actions added pl
awaelchli awaelchli removed fabric
awaelchli awaelchli removed pl
awaelchli awaelchli added feature
awaelchli awaelchli added strategy
awaelchli awaelchli added this to the 2.3 milestone 2 years ago
github-actions github-actions added fabric
github-actions github-actions added pl
awaelchli
awaelchli commented on 2024-05-04
awaelchli
awaelchli commented on 2024-05-04
awaelchli awaelchli marked this pull request as ready for review 2 years ago
awaelchli awaelchli requested a review from carmocca carmocca 2 years ago
awaelchli awaelchli requested a review from justusschock justusschock 2 years ago
awaelchli awaelchli requested a review from williamFalcon williamFalcon 2 years ago
awaelchli awaelchli requested a review from lantiga lantiga 2 years ago
awaelchli awaelchli requested a review from Borda Borda 2 years ago
awaelchli awaelchli requested a review from tchaton tchaton 2 years ago
github-actions
codecov
github-actions github-actions added docs
Borda
Borda commented on 2024-05-04
Borda
Borda approved these changes on 2024-05-04
awaelchli squash all commits
8d4b31ca
awaelchli awaelchli force pushed from 20872e9c to 8d4b31ca 2 years ago
carmocca
carmocca commented on 2024-05-06
awaelchli remove debug code in test
f2b9705f
awaelchli add dataset seeding comment
f2da1d7e
awaelchli Don't allow FSDP v1 modules
605a699e
awaelchli move parallelize function to a separate file
fc0281e2
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
b3103cef
awaelchli add more assertions
c917bee0
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
48d04ba0
awaelchli fix type hint
a4d0c691
awaelchli xfail test
309edfa6
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
e09b501e
awaelchli awaelchli requested a review from carmocca carmocca 2 years ago
carmocca
carmocca approved these changes on 2024-05-07
mergify mergify added ready to be merged
awaelchli move the materialize function to init utilities
ffa56dda
awaelchli make device mesh dimension check a unit test
4a8c3c58
awaelchli add note about mp_policy in example
aa571af8
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
6f04b369
awaelchli handle linkcheck
0d9afe83
awaelchli awaelchli merged 0c8a193d into master 2 years ago
awaelchli awaelchli deleted the examples/tp branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
feature ready to be merged docs fabric strategy pl
Milestone
2.3
Terms Of Use Privacy Policy Refund Policy Impressum