PR #5157 MOE: Fix save checkpoint when TP > 1

MOE: Fix save checkpoint when TP > 1 #5157

tjruwase merged 1 commit into deepspeedai:master from mosheisland:moe/ckp

mosheisland requested a review from

mrwyattii 1 year ago

mosheisland requested a review from

tjruwase 1 year ago

tjruwase approved these changes on 2024-02-19

MOE: Fix save checkpoint when TP > 1

64c099ab

mosheisland force pushed from bbaa158f to 64c099ab 1 year ago

tjruwase merged a84d07c5 into master 1 year ago

mosheisland deleted the moe/ckp branch 1 year ago

Reviewers

tjruwase

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone