DeepSpeed
Enable grad scaler for ZeRO-0 + torch.autocast path
#7619

Merged

Commits

show mismatching values when test fails

tohtana committed 305 days ago
Merge branch 'master' into tohtana/improve_log_dc_test_failure

tohtana committed 305 days ago
include mismatch value in exception message

tohtana committed 304 days ago
Merge branch 'master' into tohtana/enable_gradscaler_z0

tohtana committed 304 days ago
enable gradsclaer for z0+torch.autocast

tohtana committed 304 days ago
remove hard-coded tolerances

tohtana committed 304 days ago
Merge branch 'master' into tohtana/enable_gradscaler_z0

sfc-gh-truwase committed 303 days ago