PR #3861 enable autoTP for MPT

enable autoTP for MPT #3861

mrwyattii merged 5 commits into deepspeedai:master from sywangyi:auto_mpt

sywangyi requested a review from

RezaYazdaniAminabadi 2 years ago

sywangyi requested a review from

jeffra 2 years ago

sywangyi requested a review from

mrwyattii 2 years ago

sywangyi requested a review from

awan-10 2 years ago

sywangyi requested a review from

cmikeh2 2 years ago

sywangyi requested a review from

arashb 2 years ago

sywangyi force pushed from 8a59bfee to 38bbddc6 2 years ago

guoyejun commented on 2023-07-04

sywangyi force pushed from 408b81e2 to 649fd240 2 years ago

RezaYazdaniAminabadi commented on 2023-07-05

RezaYazdaniAminabadi approved these changes on 2023-07-05

sywangyi force pushed from daaa5b5b to 6947f713 2 years ago

tjruwase added merge-queue

mrwyattii requested changes on 2023-07-10

mrwyattii removed merge-queue

enable autoTP for MPT

c1110325

sywangyi force pushed from 6947f713 to c1110325 2 years ago

add model specific func to auto_tp_model_utils.py

3828c4da

Merge branch 'master' into auto_mpt

c3133c37

Merge branch 'master' into auto_mpt

eac83426

mrwyattii approved these changes on 2023-07-27

mrwyattii enabled auto-merge 2 years ago

Merge branch 'master' into auto_mpt

4b240bd4

mrwyattii merged 0bafeac4 into master 2 years ago

Reviewers

mrwyattii

RezaYazdaniAminabadi

delock

inkcherry

guoyejun

jeffra

awan-10

cmikeh2

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed enable autoTP for MPT #3861 Merged

enable autoTP for MPT #3861

DeepSpeed
enable autoTP for MPT
#3861

Merged