DeepSpeed
Fix inference MP group initialization at consequent inference calls
#1411
Merged

Fix inference MP group initialization at consequent inference calls #1411

jeffra merged 3 commits into master from inference/fix-mp-init
RezaYazdaniAminabadi
Save the model parallel group at inference engine statically
492f8754
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cli99 cli99 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from conglongli conglongli 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from eltonzheng eltonzheng 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from minjiaz minjiaz 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from niumanar niumanar 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from samyam samyam 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from ShadenSmith ShadenSmith 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from tjruwase tjruwase 4 years ago
aphedges
jeffra Merge branch 'master' into inference/fix-mp-init
a4d4f964
jeffra
jeffra approved these changes on 2021-09-30
jeffra jeffra enabled auto-merge (squash) 4 years ago
RezaYazdaniAminabadi Merge branch 'master' into inference/fix-mp-init
7318d19c
jeffra jeffra merged 9f17087f into master 4 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone