DeepSpeed
2ce6bf8c - [NPU] Add HcclBackend for 1-bit adam, 1-bit lamb, 0/1 adam (#4733)

Commit
2 years ago
[NPU] Add HcclBackend for 1-bit adam, 1-bit lamb, 0/1 adam (#4733) To support NPU devices fulfilling feature requirements like 1-bit Adam, 1-bit Lamb, 0/1 Adam, I add HcclBackend and its corresponding import logics. See what we have already done in #4567 . --------- Co-authored-by: ryan <ruanzhixiang1@huawei.com> Co-authored-by: Conglong Li <conglong.li@gmail.com>
Author
Parents
Loading