PR #6828 Add MLP/lm_head tp grain size setting.

Add MLP/lm_head tp grain size setting. #6828

loadams merged 8 commits into deepspeedai:master from Yejing-Lai:lyj/tp_grain_size

add tp grain size

55c3ddc8

Yejing-Lai requested a review from

awan-10 1 year ago

Merge branch 'master' into lyj/tp_grain_size

6befb00e

Merge branch 'master' into lyj/tp_grain_size

a5e68e0d

tjruwase approved these changes on 2024-12-10

tjruwase removed review request from

awan-10 1 year ago

tjruwase requested a review from

loadams 1 year ago

Merge branch 'master' into lyj/tp_grain_size

c884621d

updated tp_grain_size to tensor_parallel field

18428151

Merge branch 'master' into lyj/tp_grain_size

9565d3a5

Merge branch 'master' into lyj/tp_grain_size

e0c8351b

Merge branch 'master' into lyj/tp_grain_size

e129e57b

loadams merged da771ed4 into master 1 year ago

Reviewers

tjruwase

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone