DeepSpeed
6594c266 - Improve coverage of DeepCompile (#7386)

Commit
188 days ago
Improve coverage of DeepCompile (#7386) This PR improves the coverage of DeepCompile. - Use real parameters when recompilation happens - Handling overflow error in profiling This PR should be merged after #7366. ZeRO1 and ZeRO3 both worked with OpenRLHF. See [Wiki page](https://github.com/tohtana/DeepCompile_docs/wiki/Debug-with-OpenRLHF-(%237243)) for more details. --------- Signed-off-by: Masahiro Tanaka <mtanaka@microsoft.com> Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
Author
Parents
Loading