DeepSpeed

b5709cce - Enable torch compile on _allgather_params (#6769)

Enable torch compile on _allgather_params (#6769) * Previosuly ZerO3 was crashing when trying to compile _allgather_params * Disabling grad solves the issue