DeepSpeed
enable/disable moe token dropping.
#1492
Merged

Commits
  • Add a flag to enable/disable token dropping in moe/top-1 gating.
    awan-10 committed 4 years ago
  • fix syntax and formatting.
    awan-10 committed 4 years ago
  • add the missing drop_tokens entry.
    awan-10 committed 4 years ago
Loading