DeepSpeed
bf16_optimizer: fixes to different grad acc dtype
#6485

Merged

bf16_optimizer: fixes to different grad acc dtype #6485

tjruwase merged 1 commit into deepspeedai:master from nelyahu:fix_bf16_optimizer_grad_dtype

bf16_optimizer: fixes to different grad acc dtype

f72f6d84

nelyahu requested a review from

tjruwase 1 year ago

tjruwase approved these changes on 2024-09-04

tjruwase merged cfc6ed37 into master 1 year ago

Reviewers

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone