PR #6812 Support pure meta model lm_head tp

Support pure meta model lm_head tp #6812

loadams merged 10 commits into deepspeedai:master from Yejing-Lai:lyj/lm_head_replace

add lm_head tp when checkpoint is none

f4d937a2

add lm_head meta replace

2b5e7393

Yejing-Lai requested a review from

awan-10 294 days ago

Merge branch 'master' into lyj/lm_head_replace

8eeadc2b

Merge branch 'master' into lyj/lm_head_replace

c71ae343

Merge branch 'master' into lyj/lm_head_replace

c9ac0c2c

Merge branch 'master' into lyj/lm_head_replace

f214afba

delock requested a review from

hwchen2017 263 days ago

delock requested a review from

loadams 263 days ago

loadams removed review request from

awan-10 259 days ago

Merge branch 'master' into lyj/lm_head_replace

c9124f88

loadams approved these changes on 2025-01-07

loadams commented on 2025-01-07

Update AutoTP default set lm_head tp

aec4e3f8

Merge branch 'master' into lyj/lm_head_replace

32c0bc04

Merge branch 'master' into lyj/lm_head_replace

77a8107a

loadams enabled auto-merge 255 days ago

loadams merged fa8db5cf into master 255 days ago

Reviewers

loadams

hwchen2017

Assignees

No one assigned

Labels

None yet

Milestone

No milestone