DeepSpeed
88cca60a - [NPU] Add NPU to support hybrid engine (#4831)

Commit
1 year ago
[NPU] Add NPU to support hybrid engine (#4831) Add NPU to support the hybrid engine, we tested it with the example on [DeepSpeedExample](https://github.com/microsoft/DeepSpeedExamples/tree/master/applications/DeepSpeed-Chat/training/step3_rlhf_finetuning) and the results, average reward scores, were aligned with the GPU. For works about NPU, see https://github.com/microsoft/DeepSpeed/issues/4567 --------- Co-authored-by: jializheng <jializheng@huawei.com> Co-authored-by: wangshuai09 <391746016@qq.com> Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com> Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com> Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com>
Author
Parents
Loading