DeepSpeed
Release each BF16 gradient once immediate_grad_update has accumulated it
#8654
Merged
Go
Login via GitHub
Home
FAQ
Install
Login
via GitHub
Overview
Commits
7
Changes
View On
GitHub
Release each BF16 gradient once immediate_grad_update has accumulated it
#8654
tohtana
merged 7 commits into
deepspeedai:master
from
yh0903:yh0903/bf16-release-lp-grads
Release each BF16 gradient once immediate_grad_update has accumulated it
ed090241
Clear folding correction markers with consumed BF16 gradients
7054ba21
yh0903
marked this pull request as ready for review
58 days ago
yh0903
requested a review
from
tjruwase
58 days ago
yh0903
requested a review
from
tohtana
58 days ago
yh0903
requested a review
from
loadams
58 days ago
pengdurice
added
will-review
0z5a
commented on 2026-09-28
hwchen2017
requested a review
from
copilot-pull-request-reviewer
53 days ago
copilot-pull-request-reviewer
commented on 2026-09-29
tohtana
requested changes on 2026-09-29
yh0903
marked this pull request as draft
52 days ago
Merge upstream master for BF16 gradient lifecycle review
f1a000c4
yh0903
marked this pull request as ready for review
52 days ago
Fix BF16 owned-fragment gradient reconstruction on current master
bd52453e
tohtana
approved these changes on 2026-10-03
tohtana
enabled auto-merge
49 days ago
Merge branch 'master' into yh0903/bf16-release-lp-grads
ede9a9f2
Merge branch 'master' into yh0903/bf16-release-lp-grads
34704e11
tohtana
enabled auto-merge
47 days ago
Merge branch 'master' into yh0903/bf16-release-lp-grads
6601b8b3
tohtana
enabled auto-merge
43 days ago
tohtana
merged
bc1ad320
into master
43 days ago
auto-pr-labeler-with-jev
added
skip-gpu-test
Login to write a write a comment.
Login via GitHub
Reviewers
tohtana
copilot-pull-request-reviewer
0z5a
tjruwase
loadams
Assignees
No one assigned
Labels
will-review
skip-gpu-test
Milestone
No milestone
Login to write a write a comment.
Login via GitHub