PR #4713 BF16_Optimizer: add support for bf16 grad acc

BF16_Optimizer: add support for bf16 grad acc #4713

tjruwase merged 3 commits into deepspeedai:master from nelyahu:bf16_grad_acc

nelyahu requested a review from

jeffra 2 years ago

nelyahu requested a review from

tjruwase 2 years ago

tjruwase commented on 2023-11-21

bf16_optimizer: add support for bf16 grad acc

f2f278fd

nelyahu force pushed from 2f6e4b0b to f2f278fd 2 years ago

tjruwase approved these changes on 2023-11-21

Merge branch 'master' into bf16_grad_acc

805e209a

Merge branch 'master' into bf16_grad_acc

5b71c7d0

tjruwase merged ce607080 into master 2 years ago

nelyahu deleted the bf16_grad_acc branch 2 years ago

Reviewers

tjruwase

jeffra

Assignees

No one assigned

Labels

None yet

Milestone

No milestone