DeepSpeed
f0e3f01d - Add an argument to enable the injection of missing state during the conversion of universal checkpoints (#5608)

Commit
1 year ago
Add an argument to enable the injection of missing state during the conversion of universal checkpoints (#5608) This PR solves the [Issue-5430](https://github.com/microsoft/DeepSpeed/issues/5430). The PR enables the universal checkpoint feature for other platforms like HuggingFace Trainer without requiring changes to the HuggingFace code. It does this by adding an argument that allows the injection of minimal necessary information into the state before this [assertion](https://github.com/microsoft/DeepSpeed/blob/ebf82e8f3ad6d51d49d115e54a11ae4597ff36fb/deepspeed/checkpoint/ds_to_universal.py#L358). --------- Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com> Co-authored-by: Masahiro Tanaka <81312776+tohtana@users.noreply.github.com> Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com> Co-authored-by: Abhishek Kulkarni <abkulkarni@microsoft.com>
Author
Parents
Loading