DeepSpeed
69af3611 - CPUAdam fp16 and bf16 support (#5409)

Commit
1 year ago
CPUAdam fp16 and bf16 support (#5409) Hi. Please review the following changes I added support for BF16 to cpu adam. BF16, FP16 and float are supported at compilation time. the correct template is called at runtime according to input params dtype. --------- Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Author
Parents
Loading