DeepSpeed
Introduce Megatron-style parallel state management
#7726
Open
Overview
Commits
2
Changes
View On GitHub

Introduce Megatron-style parallel state management #7726

eternalNight wants to merge 2 commits into deepspeedai:master from openanolis:eternalNight/unify_process_group_management
eternalNight
Introduce Megatron-style parallel state management
9677d61e
sfc-gh-truwase
delock
eternalNight
eternalNight parallel_state: Cleanup dependency on ProcessGroupNCCL.Options
df74e043

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum