ZeRO++ #3784

jeffra merged 21 commits into master from HeyangQin/staging-zero-pp-v1
HeyangQin
samadejacobs ZeRO++ clean release (#526)
1e7a41cf
HeyangQin HeyangQin requested a review from jeffra jeffra 2 years ago
HeyangQin HeyangQin requested a review from tjruwase tjruwase 2 years ago
HeyangQin HeyangQin requested a review from samyam samyam 2 years ago
HeyangQin HeyangQin requested a review from mrwyattii mrwyattii 2 years ago
HeyangQin HeyangQin requested a review from awan-10 awan-10 2 years ago
HeyangQin HeyangQin requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
HeyangQin HeyangQin requested a review from cmikeh2 cmikeh2 2 years ago
HeyangQin HeyangQin requested a review from arashb arashb 2 years ago
HeyangQin Merge remote-tracking branch 'origin' into HeyangQin/staging-zero-pp-v1
440d4fbd
GuanhuaWang Update zeropp.md
b011295f
HeyangQin catch an edge case where MiCS and ZeRO++ both enable
97726c92
HeyangQin Merge branch 'HeyangQin/staging-zero-pp-v1' of https://github.com/mic…
3a37eca8
HeyangQin fix format
9f70a562
HeyangQin fix assert
7c764d83
HeyangQin Merge branch 'master' into HeyangQin/staging-zero-pp-v1
36f082f0
HeyangQin rearrange positional param
9d0d5d84
HeyangQin Merge branch 'HeyangQin/staging-zero-pp-v1' of https://github.com/mic…
5a300bd0
HeyangQin Merge branch 'master' into HeyangQin/staging-zero-pp-v1
1111e108
loadams Merge branch 'master' into HeyangQin/staging-zero-pp-v1
520d1d48
jeffra jeffra changed the title ZeRO++ clean release (#526) ZeRO++ 2 years ago
jeffra fix images and tags
b77fdad3
jeffra update news items
559c730c
jeffra update link for msr blog
13c52bea
HeyangQin update links
489c4091
HeyangQin add default values for AllGatherCoalescedHandle
29f26af1
jeffra
jeffra approved these changes on 2023-06-22
HeyangQin HeyangQin enabled auto-merge (squash) 2 years ago
HeyangQin Merge branch 'master' into HeyangQin/staging-zero-pp-v1
8a310566
jeffra jeffra added merge-queue
HeyangQin Merge branch 'master' into HeyangQin/staging-zero-pp-v1
0140ae1a
conglongli Merge branch 'master' into HeyangQin/staging-zero-pp-v1
60806d4a
jeffra Merge branch 'master' into HeyangQin/staging-zero-pp-v1
a5bf0bad
disabled auto-merge 2 years ago
Manually disabled by user
jeffra jeffra merged e1119d8b into master 2 years ago
jeffra jeffra deleted the HeyangQin/staging-zero-pp-v1 branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone