DeepSpeed
b6346bf0 - double reduction user-friendly error (#7895)

Commit
27 days ago
double reduction user-friendly error (#7895) Currently a numerical order of the param tells nothing to the user of what param is the problem. This PR fixes that. before: ``` AssertionError: The parameter 0 has already been reduced. ... ``` after: ``` AssertionError: The parameter model.embed_tokens.weight has already been reduced. ```
Author
Parents
Loading