DeepSpeed
06379688 - Merge branch 'tohtana/z3_moe_bwd' into tohtana/compile-zero

Commit

1 year ago

Merge branch 'tohtana/z3_moe_bwd' into tohtana/compile-zero

References

#4878 - Enable torch.compile with ZeRO (Experimental)

Author

Masahiro Tanaka

Parents

Loading