DeepSpeed
Fix for dist not being initialized when constructing main config
#3324
Merged

Fix for dist not being initialized when constructing main config #3324

mrwyattii merged 7 commits into master from mrwyattii/fix-dist-init
mrwyattii
mrwyattii move dist init out of Engine
dd0b8252
mrwyattii move global dist
814d5302
mrwyattii fix dist import
cdfa4e7b
stas00
stas00 commented on 2023-04-20
stas00
mrwyattii Merge branch 'master' into mrwyattii/fix-dist-init
da99991c
mrwyattii remove check for older torch
d695a3a3
mrwyattii mrwyattii marked this pull request as ready for review 2 years ago
mrwyattii mrwyattii requested a review from jeffra jeffra 2 years ago
mrwyattii mrwyattii requested a review from tjruwase tjruwase 2 years ago
mrwyattii mrwyattii requested a review from awan-10 awan-10 2 years ago
mrwyattii re-add code that should not have been removed
d24742f1
mrwyattii
stas00
stas00
stas00 commented on 2023-04-20
mrwyattii Update engine.py
33b07a56
mrwyattii mrwyattii enabled auto-merge (squash) 2 years ago
tjruwase
tjruwase approved these changes on 2023-04-20
disabled auto-merge 2 years ago
Manually disabled by user
mrwyattii mrwyattii merged ad168a69 into master 2 years ago
stas00
jeffra
stas00
pacman100
mrwyattii mrwyattii deleted the mrwyattii/fix-dist-init branch 2 years ago
conglongli conglongli added deepspeed-chat
conglongli conglongli removed deepspeed-chat

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone