DeepSpeed
Release each BF16 gradient once immediate_grad_update has accumulated it
#8654
Merged
Overview
Commits
7
Changes
View On GitHub

Release each BF16 gradient once immediate_grad_update has accumulated it #8654

tohtana merged 7 commits into deepspeedai:master from yh0903:yh0903/bf16-release-lp-grads
yh0903
yh0903 Release each BF16 gradient once immediate_grad_update has accumulated it
ed090241
yh0903 Clear folding correction markers with consumed BF16 gradients
7054ba21
yh0903 yh0903 marked this pull request as ready for review 22 days ago
yh0903 yh0903 requested a review from tjruwase tjruwase 22 days ago
yh0903 yh0903 requested a review from tohtana tohtana 22 days ago
yh0903 yh0903 requested a review from loadams loadams 22 days ago
pengdurice pengdurice added will-review
0z5a
0z5a commented on 2026-09-28
hwchen2017 hwchen2017 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 17 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-09-29
tohtana
tohtana requested changes on 2026-09-29
yh0903 yh0903 marked this pull request as draft 17 days ago
yh0903 Merge upstream master for BF16 gradient lifecycle review
f1a000c4
yh0903 yh0903 marked this pull request as ready for review 17 days ago
yh0903 Fix BF16 owned-fragment gradient reconstruction on current master
bd52453e
yh0903
tohtana
tohtana approved these changes on 2026-10-03
tohtana tohtana enabled auto-merge 13 days ago
tohtana Merge branch 'master' into yh0903/bf16-release-lp-grads
ede9a9f2
tohtana Merge branch 'master' into yh0903/bf16-release-lp-grads
34704e11
tohtana tohtana enabled auto-merge 12 days ago
tohtana Merge branch 'master' into yh0903/bf16-release-lp-grads
6601b8b3
tohtana tohtana enabled auto-merge 8 days ago
tohtana tohtana merged bc1ad320 into master 8 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
will-review
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum