DeepSpeed
9976681a - Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO 1

Commit

4 years ago

Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO 1

References

#1985 - DeepSpeed Comm. Backend v1

Author

Quentin-Anthony

Quentin-Anthony

Parents

Loading