DeepSpeed
Fix FPDT K/V gradient buffers under grouped-query attention
#8665

Merged

Fix FPDT K/V gradient buffers under grouped-query attention #8665

tohtana merged 2 commits into deepspeedai:master from jinyouzhi:fix-fpdt-gqa-backward-kv-grad

jinyouzhi requested a review from

tohtana 39 days ago

jinyouzhi requested a review from

tjruwase 39 days ago

jinyouzhi requested a review from

loadams 39 days ago

Fix FPDT K/V gradient buffers under grouped-query attention

d7c98989

pengdurice added will-review

hwchen2017 approved these changes on 2026-09-26

Merge branch 'master' into fix-fpdt-gqa-backward-kv-grad

49d5bc9d

tohtana approved these changes on 2026-09-29

tohtana enabled auto-merge 35 days ago

tohtana merged ece19cfe into master 35 days ago

Reviewers

tohtana

hwchen2017

tjruwase

loadams

Assignees

No one assigned

Labels

will-review

Milestone

No milestone