DeepSpeed
NCCL-based 1-bit Adam + Code Refactor for Comm. Backends
#594
Merged
Overview
Commits
4
Changes
View On GitHub

NCCL-based 1-bit Adam + Code Refactor for Comm. Backends #594

jeffra merged 4 commits into staging-1bit-nccl-v2 from staging-1bit-nccl-v1
awan-10
awan-10 NCCL based 1-bit Implementation + Refactor to add communication backe…
3e85a17b
awan-10 Remove old collectives file.
562be213
awan-10 awan-10 requested a review from arashashari arashashari 5 years ago
awan-10 awan-10 requested a review from cli99 cli99 5 years ago
awan-10 awan-10 requested a review from conglongli conglongli 5 years ago
awan-10 awan-10 requested a review from eltonzheng eltonzheng 5 years ago
awan-10 awan-10 requested a review from jeffra jeffra 5 years ago
awan-10 awan-10 requested a review from minjiaz minjiaz 5 years ago
awan-10 awan-10 requested a review from niumanar niumanar 5 years ago
awan-10 awan-10 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
awan-10 awan-10 requested a review from samyam samyam 5 years ago
awan-10 awan-10 requested a review from ShadenSmith ShadenSmith 5 years ago
awan-10 awan-10 requested a review from tjruwase tjruwase 5 years ago
awan-10 Undo a typo.
ce5dd1d1
awan-10 Graceful failure for torch versions that don't support nccl pt2pt.
3fb36a04
awan-10
jeffra
jeffra approved these changes on 2020-12-14
jeffra jeffra merged a6dba72a into staging-1bit-nccl-v2 5 years ago
mrwyattii mrwyattii deleted the staging-1bit-nccl-v1 branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum