DeepSpeed
[CANN] Support cpu offload optimizer for Ascend NPU
#4568

Merged

[CANN] Support cpu offload optimizer for Ascend NPU #4568

tjruwase merged 4 commits into deepspeedai:master from hipudding:cpu_adam

hipudding requested a review from

jeffra 2 years ago

hipudding requested a review from

tjruwase 2 years ago

hipudding requested a review from

mrwyattii 2 years ago

hipudding requested a review from

RezaYazdaniAminabadi 2 years ago

hipudding requested a review from

cmikeh2 2 years ago

hipudding requested a review from

awan-10 2 years ago

hipudding requested a review from

arashb 2 years ago

hipudding marked this pull request as draft 2 years ago

hipudding force pushed from 6489edcd to f5723730 2 years ago

hipudding force pushed from f5723730 to 07916e00 2 years ago

hipudding changed the title ~~[WIP][CANN] Support cpu_adam optimizer for NPU~~ [CANN] Support cpu offload optimizer for NPU 2 years ago

hipudding changed the title ~~[CANN] Support cpu offload optimizer for NPU~~ [CANN] Support cpu offload optimizer for Ascend NPU 2 years ago

hipudding force pushed from 07916e00 to 4deb6f62 2 years ago

hipudding force pushed from 4deb6f62 to 11d61cbb 2 years ago

[CANN] Support cpu offload optimizer for NPU

91b0976c

hipudding force pushed from 11d61cbb to 91b0976c 2 years ago

hipudding marked this pull request as ready for review 2 years ago

Merge branch 'master' into cpu_adam

6d33acc2

Merge branch 'master' into cpu_adam

d2fe01e2

Fix code format and spell issue

b77e8921

tjruwase approved these changes on 2023-11-14

tjruwase merged c1ba6a10 into master 2 years ago

Reviewers

tjruwase

jeffra

mrwyattii

RezaYazdaniAminabadi

cmikeh2

awan-10

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed [CANN] Support cpu offload optimizer for Ascend NPU #4568 Merged

[CANN] Support cpu offload optimizer for Ascend NPU #4568

DeepSpeed
[CANN] Support cpu offload optimizer for Ascend NPU
#4568

Merged