DeepSpeed
Assert mp_size is factor of model dimensions
#2891
Merged

Assert mp_size is factor of model dimensions #2891

jeffra merged 7 commits into master from mosm/mpsize_check
molly-smith
molly-smith Enforce mp_size is factor of model parameters such as hidden size
0f11aa1c
molly-smith molly-smith marked this pull request as ready for review 3 years ago
molly-smith molly-smith requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
molly-smith molly-smith requested a review from jeffra jeffra 3 years ago
molly-smith molly-smith requested a review from mrwyattii mrwyattii 3 years ago
molly-smith molly-smith requested a review from awan-10 awan-10 3 years ago
molly-smith molly-smith requested a review from cmikeh2 cmikeh2 3 years ago
molly-smith molly-smith requested a review from arashb arashb 3 years ago
molly-smith Merge branch 'master' into mosm/mpsize_check
5246b94f
molly-smith Merge branch 'master' into mosm/mpsize_check
ce0c4132
tjruwase
tjruwase commented on 2023-03-03
molly-smith include param sizes in assert message
e92e13f0
molly-smith Merge branch 'master' into mosm/mpsize_check
150ddb64
jeffra
jeffra approved these changes on 2023-03-17
jeffra jeffra added merge-queue
jeffra Merge branch 'master' into mosm/mpsize_check
a5976c18
jeffra change test name for amd
96e5a7b2
jeffra jeffra merged 9ea0fdc2 into master 2 years ago
jeffra jeffra deleted the mosm/mpsize_check branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone