[ROCm] UTs and code clean up (#10511)
* Fix UT
* UT
* UTs
* enable ROCm UT
* fix build attempt
* minor
* fix UT
* fix UT
* fix UTs
Co-authored-by: Ethan Tao <ettao@microsoft.com@orttrainingdev7.d32nl1ml4oruzj4qz3bqlggovf.px.internal.cloudapp.net>
Co-authored-by: root <root@GCRAMDRR1-MI100-087.redmond.corp.microsoft.com>
