DeepSpeed
Fix numerical stability in Triton masked softmax
#8782

Merged

Fix numerical stability in Triton masked softmax #8782

pengdurice merged 3 commits into deepspeedai:master from arcusbuilds:fix/triton-masked-softmax-stability

Fix numerical stability in Triton masked softmax

fbb1633a

arcusbuilds requested a review from

tohtana 26 days ago

arcusbuilds requested a review from

tjruwase 26 days ago

arcusbuilds requested a review from

loadams 26 days ago

chatgpt-codex-connector commented on 2026-10-09

hwchen2017 commented on 2026-10-09

hwchen2017 requested a review from

copilot-pull-request-reviewer 26 days ago

copilot-pull-request-reviewer commented on 2026-10-09

Remove redundant small-mask-difference softmax test

79b6def8

hwchen2017 approved these changes on 2026-10-12

Merge branch 'master' into fix/triton-masked-softmax-stability

5c392fad

pengdurice enabled auto-merge 14 days ago

pengdurice added will-review

pengdurice merged 67ec1961 into master 14 days ago

Reviewers

hwchen2017

tohtana

tjruwase

loadams

Assignees

No one assigned

Labels

will-review

Milestone

No milestone