DeepSpeed
Introduce Megatron-style parallel state management
#7726
Open
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
2
Changes
View On
GitHub
Introduce Megatron-style parallel state management
#7726
eternalNight
wants to merge 2 commits into
deepspeedai:master
from
openanolis:eternalNight/unify_process_group_management
Introduce Megatron-style parallel state management
9677d61e
parallel_state: Cleanup dependency on ProcessGroupNCCL.Options
df74e043
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub