Run CI in a new environment (#92378)
Needed to be able to install newer Python versions (Python-3.11 in this case), which do not have numerous packages that default environment must have
In addition, fix weird incursion of `conda-forge` by torch-deploy test.
Reincarnation of an old https://github.com/pytorch/pytorch/pull/66530
Pull Request resolved: https://github.com/pytorch/pytorch/pull/92378
Approved by: https://github.com/kit1980
