DeepSpeed
DeepSpeed MoE
#1310
Merged
Overview
Commits
22
Changes
View On GitHub

DeepSpeed MoE #1310

awan-10 merged 22 commits into master from staging-moe-zero-v3
awan-10
jeffra [squash] Staging moe zero v2 (#237)
3001411b
awan-10 Add assertion for batch size and min_capacity. (#238)
b7e0211d
jeffra tutorial changes
b1ec41d2
samyam assert for fp16_master_params_and_grads (#240)
fb28255d
awan-10 Add some groups stuff.
6cde38cb
awan-10 minor format.
c0cc16ca
awan-10 add table1
338ab54d
awan-10 fix table a bit more
f2f2c3c6
awan-10 finalize table 1.
12e275c9
awan-10 check some api
40b91632
awan-10 cleanup
ab5e5fd1
awan-10 add some example.
b1bf4ac4
awan-10 simply.
f287dacf
awan-10 some more changes.
2601e24c
awan-10 check format
427dded7
awan-10 add zero stuff
03f4b8d4
awan-10 fix
410eb9b0
awan-10 add rts
fe149cc4
awan-10 remove paper link
1d78b51e
jeffra cleanup
3f2d9b2a
awan-10 awan-10 requested a review from cli99 cli99 4 years ago
awan-10 awan-10 requested a review from conglongli conglongli 4 years ago
awan-10 awan-10 requested a review from eltonzheng eltonzheng 4 years ago
awan-10 awan-10 requested a review from jeffra jeffra 4 years ago
awan-10 awan-10 requested a review from minjiaz minjiaz 4 years ago
awan-10 awan-10 requested a review from niumanar niumanar 4 years ago
awan-10 awan-10 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
awan-10 awan-10 requested a review from samyam samyam 4 years ago
awan-10 awan-10 requested a review from ShadenSmith ShadenSmith 4 years ago
awan-10 awan-10 requested a review from tjruwase tjruwase 4 years ago
jeffra bump to 0.5.0
53daa42b
jeffra formatting
acfd0301
awan-10 awan-10 enabled auto-merge (squash) 4 years ago
jeffra
jeffra approved these changes on 2021-08-17
awan-10 awan-10 merged f2843244 into master 4 years ago
awan-10 awan-10 deleted the staging-moe-zero-v3 branch 4 years ago
tjruwase
tjruwase commented on 2024-05-06

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum