DeepSpeed
Set tp world size to 1 in ckpt load, if MPU is not provided
#5243
Merged

Set tp world size to 1 in ckpt load, if MPU is not provided #5243

tjruwase merged 1 commit into master from fix_mpu_ckpt
samadejacobs
samadejacobs Set tp world size to 1 in ckpt load, if MPU is not provided
b75647c4
samadejacobs samadejacobs requested a review from tjruwase tjruwase 1 year ago
samadejacobs samadejacobs requested a review from mrwyattii mrwyattii 1 year ago
tjruwase
tjruwase approved these changes on 2024-03-08
tjruwase tjruwase merged 535a908f into master 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone