DeepSpeed
[NPU] Add HcclBackend for 1-bit adam, 1-bit lamb, 0/1 adam
#4733
Merged

Commits
  • feat: add HcclBackend as communication backend to support onebit adam | onebit lamb | 0/1 adam
    RUAN-ZX committed 2 years ago
  • feat: add HcclBackend import branch for OnebitAdam
    RUAN-ZX committed 2 years ago
  • feat: add HcclBackend import branch for OnebitLamb
    RUAN-ZX committed 2 years ago
  • feat: add HcclBackend import branch for 0/1 Adam
    RUAN-ZX committed 2 years ago
  • Merge branch 'master' into master-1bit-hcclbackend
    conglongli committed 2 years ago
  • refactor: solve yapf problems
    RUAN-ZX committed 2 years ago
  • Merge remote-tracking branch 'origin/master-1bit-hcclbackend' into master-1bit-hcclbackend
    RUAN-ZX committed 2 years ago
  • fix: use deepspeed.comm as dist
    RUAN-ZX committed 2 years ago
  • Merge branch 'master' into master-1bit-hcclbackend
    conglongli committed 2 years ago
  • Merge branch 'master' into master-1bit-hcclbackend
    conglongli committed 2 years ago
Loading