DeepSpeed
MOE: Fix save checkpoint when TP > 1
#5157
Merged

Commits
  • MOE: Fix save checkpoint when TP > 1
    mosheisland committed 2 years ago
Loading