DeepSpeed
[AutoTP] Enable HF `colwise_gather_output` to support `lm_head` replace
#8146
Merged
Overview
Commits
12
Changes
View On GitHub

[AutoTP] Enable HF `colwise_gather_output` to support `lm_head` replace #8146

delock merged 12 commits into deepspeedai:master from jinyouzhi:lm_head_colwise
jinyouzhi
jinyouzhi jinyouzhi requested a review from tjruwase tjruwase 18 days ago
jinyouzhi jinyouzhi requested a review from tohtana tohtana 18 days ago
jinyouzhi jinyouzhi requested a review from hwchen2017 hwchen2017 18 days ago
jinyouzhi jinyouzhi requested a review from loadams loadams 18 days ago
jinyouzhi jinyouzhi force pushed from 386d2bf3 to 67285d60 18 days ago
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-07-15
jinyouzhi jinyouzhi force pushed from 67285d60 to 4e320483 17 days ago
jinyouzhi jinyouzhi force pushed from c9b64666 to 2ab4f47a 17 days ago
jinyouzhi jinyouzhi force pushed from 2ab4f47a to c63d2d44 17 days ago
jinyouzhi Implement gathered column parallelism support and enhance AutoTP conf…
18e7227e
jinyouzhi Enhance AutoTP logging for lm_head diagnostics and improve HuggingFac…
4a456940
jinyouzhi Refactor AutoTP gathered column tie handling and update related tests…
0e2a0c24
jinyouzhi fix the AttributeError for _gathered_column_tie_fallbacks_configured
02b214cd
jinyouzhi handle uneven gathered lm_head shards
c63d2d44
PKUWZP PKUWZP requested a review from PKUWZP PKUWZP 17 days ago
delock
delock commented on 2026-07-17
PKUWZP
PKUWZP requested changes on 2026-07-17
delock
delock commented on 2026-07-17
delock
delock commented on 2026-07-17
jinyouzhi
jinyouzhi fix pattern
bca340e3
jinyouzhi fix code style
da9d0db1
jinyouzhi Merge remote-tracking branch 'origin/master' into HEAD
fdfce903
jinyouzhi add ut for uneven vocab slice
afc886fc
delock
delock delock enabled auto-merge 10 days ago
jinyouzhi
delock Merge branch 'master' into lm_head_colwise
5f982d6a
delock delock requested a review from PKUWZP PKUWZP 9 days ago
delock Merge branch 'master' into lm_head_colwise
e377fefc
jinyouzhi
jinyouzhi jinyouzhi changed the title [AutoTP] Enalbe HF `colwise_gather_output` to support `lm_head` replace [AutoTP] Enable HF `colwise_gather_output` to support `lm_head` replace 6 days ago
disabled auto-merge 6 days ago
Manually disabled by user
delock delock enabled auto-merge 6 days ago
jinyouzhi Merge branch 'master' into lm_head_colwise
90edcf27
PKUWZP
PKUWZP approved these changes on 2026-07-29
delock delock merged 48d54e05 into master 4 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum