[vulkan] Refactor Adapter to have PhysicalDevice hold physical device properties (#80701)
Differential Revision: [D36824002](https://our.internmc.facebook.com/intern/diff/D36824002/)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/80701
Approved by: https://github.com/kimishpatel
