PR #2891 Assert mp_size is factor of model dimensions

Assert mp_size is factor of model dimensions #2891

jeffra merged 7 commits into master from mosm/mpsize_check

Enforce mp_size is factor of model parameters such as hidden size

0f11aa1c

molly-smith marked this pull request as ready for review 3 years ago

molly-smith requested a review from

RezaYazdaniAminabadi 3 years ago

molly-smith requested a review from

jeffra 3 years ago

molly-smith requested a review from

mrwyattii 3 years ago

molly-smith requested a review from

awan-10 3 years ago

molly-smith requested a review from

cmikeh2 3 years ago

molly-smith requested a review from

arashb 3 years ago

Merge branch 'master' into mosm/mpsize_check

5246b94f

Merge branch 'master' into mosm/mpsize_check

ce0c4132

tjruwase commented on 2023-03-03

include param sizes in assert message

e92e13f0

Merge branch 'master' into mosm/mpsize_check

150ddb64

jeffra approved these changes on 2023-03-17

jeffra added merge-queue

Merge branch 'master' into mosm/mpsize_check

a5976c18

change test name for amd

96e5a7b2

jeffra merged 9ea0fdc2 into master 2 years ago

jeffra deleted the mosm/mpsize_check branch 2 years ago

Reviewers

jeffra

tjruwase

RezaYazdaniAminabadi

mrwyattii

awan-10

cmikeh2

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Assert mp_size is factor of model dimensions #2891 Merged

Assert mp_size is factor of model dimensions #2891

DeepSpeed
Assert mp_size is factor of model dimensions
#2891

Merged