DeepSpeed
[AutoSP] Align cross entropy targets after an in-model causal label shift
#8811
Merged

[AutoSP] Align cross entropy targets after an in-model causal label shift #8811

jinyouzhi
jinyouzhi jinyouzhi marked this pull request as ready for review 39 days ago
jinyouzhi jinyouzhi requested a review from tjruwase tjruwase 39 days ago
jinyouzhi jinyouzhi requested a review from tohtana tohtana 39 days ago
jinyouzhi jinyouzhi requested a review from loadams loadams 39 days ago
chatgpt-codex-connector
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-10-13
jinyouzhi jinyouzhi force pushed from 6f7c57b9 to b166cd8d 39 days ago
jinyouzhi jinyouzhi marked this pull request as draft 35 days ago
jinyouzhi jinyouzhi marked this pull request as ready for review 19 days ago
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-02
jinyouzhi jinyouzhi closed this 17 days ago
jinyouzhi jinyouzhi reopened this 17 days ago
jinyouzhi jinyouzhi marked this pull request as draft 17 days ago
tohtana tohtana added needs-gpu-test
tohtana tohtana removed needs-gpu-test
jinyouzhi jinyouzhi marked this pull request as ready for review 4 days ago
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-18
tohtana
tohtana requested changes on 2026-11-18
jinyouzhi jinyouzhi force pushed from 3372a814 to b686c903 3 days ago
auto-pr-labeler-with-jev auto-pr-labeler-with-jev added skip-gpu-test
jinyouzhi
jinyouzhi jinyouzhi requested a review from tohtana tohtana 3 days ago
jinyouzhi AutoSP: align cross entropy targets with sharded logits after an in-m…
698c9b07
jinyouzhi [AutoSP] Address review on configs, the dataloader and label alignment
b686c903
auto-pr-labeler-with-jev auto-pr-labeler-with-jev removed skip-gpu-test
auto-pr-labeler-with-jev auto-pr-labeler-with-jev added skip-gpu-test
auto-pr-labeler-with-jev auto-pr-labeler-with-jev removed skip-gpu-test
jinyouzhi [AutoSP] Note that some unsupported logits reorders may go undetected
f2750549
jinyouzhi Merge branch 'master' into autosp-label-shift
eac45e53
tohtana
tohtana approved these changes on 2026-11-19
tohtana Merge branch 'master' into autosp-label-shift
00b1f5d9
tohtana tohtana enabled auto-merge 2 days ago
jinyouzhi
tohtana tohtana merged adcabcf9 into master 1 day ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone