Fix building on Windows with presence of Triton (#6749)
This fixes some errors when installing DeepSpeed on Windows with the
presence of Triton.
I guess we can assume we don't need the warning about NFS on Windows for
now. I did not try how to detect NFS path on Windows, but we can detect
UNC path starting with `\\` if needed.
`os.rename` does not allow overwriting the file on Windows, and
`os.replace` is more cross-platform.
Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>
