DeepSpeed
BF16 optimizer: Improve device utilization by immediate grad update
#4975
Merged
Overview
Commits
6
Changes
View On GitHub

BF16 optimizer: Improve device utilization by immediate grad update #4975

tjruwase merged 6 commits into deepspeedai:master from deepcharm:bf16-optim-immediate-grad-update
deepcharm
deepcharm deepcharm requested a review from mrwyattii mrwyattii 2 years ago
deepcharm deepcharm requested a review from tjruwase tjruwase 2 years ago
deepcharm deepcharm force pushed from 5bcbbbc7 to 4eb37e04 2 years ago
deepcharm BF16 optimizer: Improve device utilization by immediate grad update
cfcbcc6f
deepcharm Update bf16_optimizer.py
1000955d
deepcharm Update config.py
d1dc6dd8
deepcharm deepcharm force pushed from 4eb37e04 to d1dc6dd8 2 years ago
deepcharm Merge branch 'master' into bf16-optim-immediate-grad-update
b389ebfc
deepcharm Merge branch 'master' into bf16-optim-immediate-grad-update
4fc92318
tjruwase
tjruwase approved these changes on 2024-02-08
tjruwase Merge branch 'master' into bf16-optim-immediate-grad-update
029615a3
tjruwase tjruwase merged 3c0bd312 into master 2 years ago
deepcharm deepcharm deleted the bf16-optim-immediate-grad-update branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum