DeepSpeed
91dc69a7 - Simplify layernorm tracking. Add unittest.

Commit

3 years ago

Simplify layernorm tracking. Add unittest.

References

#2670 - Automatic tensor parallelism v2

Author

molly-smith

molly-smith

Parents

Loading