DeepSpeed
377a0d15
- replace moe checkpoint dp_world_size with seq_dp_world_size (#7732)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
9 days ago
replace moe checkpoint dp_world_size with seq_dp_world_size (#7732) Replace moe checkpoint dp_world_size with seq_dp_world_size to sup moe module with seq parallel. Co-authored-by: Olatunji Ruwase <tunji.ruwase@snowflake.com>
References
#7732 - replace moe checkpoint dp_world_size with seq_dp_world_size
Author
wukong1992
Parents
d7d4eebc
Loading