Adding support for torchrun in xla backend (#3609)
* Adding support for torchrun in xla backend
* Adding support for custom specification of devices and associated tests
* Revert "Adding support for custom specification of devices and associated tests"
This reverts commit a66060c96448202ddf60c29a8a3454133c0d17cd.
* Adding support for custom specification of devices and associated tests
* Updated xrt initialization to work with TPU based flow
* Cleanup xrt initialization to work with torchrun/slurm
* Adding tests to CI pipeline
* Fix Lint/CI issues
* Fixing Lint Error
* Lint changes
