DeepSpeed
MOE: Fix save checkpoint when TP > 1
#5157
Merged

Commits
  • MOE: Fix save checkpoint when TP > 1
    mosheisland committed 1 year ago
Loading