DeepSpeed
fc854363 - z2: report param name and not zero id in assert (#7637)

Commit
69 days ago
z2: report param name and not zero id in assert (#7637) This PR improves user experience by moving away from: ``` AssertionError: The parameter 200 has already been reduced.... ``` towards: ``` AssertionError: The parameter lm_head.weight has already been reduced... ``` now the user can probably start unravelling where the problem is.
Author
Parents
Loading