DeepSpeed
ccc17ae6 - save progress on debug, currently working in the 1 gpu case.

Commit

4 years ago

save progress on debug, currently working in the 1 gpu case. Need to extend to multi-gpu case and test/fix zero-2 case still pending investigation.

References

Author

jeffra

Parents