DeepSpeed
25b2fc29 - Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO-1 (#2007)

Commit

3 years ago

Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO-1 (#2007) Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>

References

Author

Quentin-Anthony

Parents