Use default build env and test config for test times (#107325)
Redo of #107312
Pairs with https://github.com/pytorch/test-infra/pull/4476
If build env and test config combo cannot be found in the test times, use default. Then we don't have to go manually change the test-times.json a new job is added or we update the jobs.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/107325
Approved by: https://github.com/huydhn
