Enable TF32 for training on A100 (#4914)

Commit

5 years ago

Enable TF32 for training on A100 (#4914) * enable TF32 for training on A100 it can be disabled by env: NVIDIA_TF32_OVERRIDE = 0