DeepSpeed
Enforce nccl/rccl alignment of start location of each shard
#1564
Merged
Overview
Commits
4
Changes
View On GitHub

Enforce nccl/rccl alignment of start location of each shard #1564

tjruwase merged 4 commits into deepspeedai:master from amathews-amd:rccl_alignment_sharding_fix
amathews-amd
amathews-amd Enforce nccl/rccl alignment of start location of each shard
6322a22f
amathews-amd Making yapf happy
7e4a6272
amathews-amd amathews-amd marked this pull request as ready for review 4 years ago
amathews-amd amathews-amd requested a review from awan-10 awan-10 4 years ago
amathews-amd amathews-amd requested a review from cli99 cli99 4 years ago
amathews-amd amathews-amd requested a review from conglongli conglongli 4 years ago
amathews-amd amathews-amd requested a review from eltonzheng eltonzheng 4 years ago
amathews-amd amathews-amd requested a review from jeffra jeffra 4 years ago
amathews-amd amathews-amd requested a review from minjiaz minjiaz 4 years ago
amathews-amd amathews-amd requested a review from niumanar niumanar 4 years ago
amathews-amd amathews-amd requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
amathews-amd amathews-amd requested a review from samyam samyam 4 years ago
amathews-amd amathews-amd requested a review from ShadenSmith ShadenSmith 4 years ago
amathews-amd amathews-amd requested a review from tjruwase tjruwase 4 years ago
tjruwase Merge branch 'master' into rccl_alignment_sharding_fix
9161a5a8
tjruwase
tjruwase approved these changes on 2021-11-16
tjruwase Merge branch 'master' into rccl_alignment_sharding_fix
c645bcc3
tjruwase tjruwase merged 4a0b1032 into master 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum