DeepSpeed
fix partition activations issue when mp=2 and pp=2
#1589
Merged

fix partition activations issue when mp=2 and pp=2 #1589

tjruwase merged 4 commits into master from eltonz/fix-partition-activations
eltonzheng
eltonzheng fix partition activations issue when mp=2 and pp=2
7312e1a7
eltonzheng eltonzheng requested a review from tjruwase tjruwase 3 years ago
eltonzheng eltonzheng requested a review from awan-10 awan-10 3 years ago
eltonzheng eltonzheng requested a review from cli99 cli99 3 years ago
eltonzheng eltonzheng requested a review from conglongli conglongli 3 years ago
eltonzheng eltonzheng requested a review from jeffra jeffra 3 years ago
eltonzheng eltonzheng requested a review from minjiaz minjiaz 3 years ago
eltonzheng eltonzheng requested a review from niumanar niumanar 3 years ago
eltonzheng eltonzheng requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
eltonzheng eltonzheng requested a review from samyam samyam 3 years ago
eltonzheng eltonzheng requested a review from ShadenSmith ShadenSmith 3 years ago
tjruwase tjruwase removed review request from jeffra jeffra 3 years ago
tjruwase tjruwase removed review request from conglongli conglongli 3 years ago
tjruwase tjruwase removed review request from awan-10 awan-10 3 years ago
tjruwase tjruwase removed review request from cli99 cli99 3 years ago
tjruwase tjruwase removed review request from minjiaz minjiaz 3 years ago
tjruwase tjruwase removed review request from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
tjruwase tjruwase removed review request from niumanar niumanar 3 years ago
tjruwase
tjruwase commented on 2021-11-23
tjruwase
tjruwase approved these changes on 2021-11-23
eltonzheng change util function input and fix pre-commit errors
fa6169ca
tjruwase
tjruwase tjruwase enabled auto-merge (squash) 3 years ago
stas00
stas00 commented on 2021-11-23
disabled auto-merge 3 years ago
Manually disabled by user
eltonzheng move print_backward_tensors() to debug.py
ee7131df
tjruwase Merge branch 'master' into eltonz/fix-partition-activations
ccc8e5c5
tjruwase tjruwase merged 51d42ab9 into master 3 years ago
stas00
mrwyattii mrwyattii deleted the eltonz/fix-partition-activations branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone