DeepSpeed
Use odd shape tensor to represent parameter data in partitioned state
#981
Merged

Use odd shape tensor to represent parameter data in partitioned state #981

cli99
cli99 use wierd shaped tensor to avoid silent failures when not registering…
250d0a28
cli99 fix typo
060285bd
cli99 cli99 marked this pull request as ready for review 4 years ago
cli99 cli99 requested a review from arashashari arashashari 4 years ago
cli99 cli99 requested a review from awan-10 awan-10 4 years ago
cli99 cli99 requested a review from conglongli conglongli 4 years ago
cli99 cli99 requested a review from eltonzheng eltonzheng 4 years ago
cli99 cli99 requested a review from jeffra jeffra 4 years ago
cli99 cli99 requested a review from minjiaz minjiaz 4 years ago
cli99 cli99 requested a review from niumanar niumanar 4 years ago
cli99 cli99 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
cli99 cli99 requested a review from samyam samyam 4 years ago
cli99 cli99 requested a review from ShadenSmith ShadenSmith 4 years ago
cli99 cli99 requested a review from tjruwase tjruwase 4 years ago
tjruwase
tjruwase approved these changes on 2021-04-20
tjruwase Merge branch 'master' into cheng/partitioned-param-representation
2e5a950e
cli99 Merge branch 'master' into cheng/partitioned-param-representation
174dba35
cli99 cli99 merged 894f21da into master 4 years ago
cli99 cli99 deleted the cheng/partitioned-param-representation branch 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone