DeepSpeed
[NPU] Add HcclBackend for 1-bit adam, 1-bit lamb, 0/1 adam
#4733
Merged

[NPU] Add HcclBackend for 1-bit adam, 1-bit lamb, 0/1 adam #4733

RUAN-ZX
RUAN-ZX feat: add HcclBackend as communication backend to support onebit adam…
8fcaf6d0
RUAN-ZX feat: add HcclBackend import branch for OnebitAdam
fa4a3d56
RUAN-ZX feat: add HcclBackend import branch for OnebitLamb
40a541e3
RUAN-ZX feat: add HcclBackend import branch for 0/1 Adam
67bd87db
RUAN-ZX RUAN-ZX requested a review from conglongli conglongli 2 years ago
RUAN-ZX RUAN-ZX requested a review from awan-10 awan-10 2 years ago
RUAN-ZX
RUAN-ZX
RUAN-ZX
conglongli conglongli assigned conglongli conglongli 2 years ago
conglongli Merge branch 'master' into master-1bit-hcclbackend
76b31ea0
conglongli
CurryRice233
conglongli
RUAN-ZX refactor: solve yapf problems
7922d13e
RUAN-ZX Merge remote-tracking branch 'origin/master-1bit-hcclbackend' into ma…
114831ad
conglongli
conglongli approved these changes on 2023-12-08
conglongli conglongli enabled auto-merge 2 years ago
RUAN-ZX fix: use deepspeed.comm as dist
d0cb8e60
disabled auto-merge 2 years ago
Head branch was pushed to by a user without write access
RUAN-ZX RUAN-ZX requested a review from conglongli conglongli 2 years ago
RUAN-ZX
conglongli
conglongli Merge branch 'master' into master-1bit-hcclbackend
abf696fb
conglongli conglongli enabled auto-merge 2 years ago
conglongli Merge branch 'master' into master-1bit-hcclbackend
1f8f2800
conglongli conglongli merged 2ce6bf8c into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone