DeepSpeed
56635d5b - enable/disable moe token dropping. (#1492)

Commit

3 years ago

enable/disable moe token dropping. (#1492) * Add a flag to enable/disable token dropping in moe/top-1 gating. * fix syntax and formatting.

References

Author

awan-10

Parents