[vulkan] fix invalid memory op and tests (#43312)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/43312
Test Plan: Imported from OSS
Reviewed By: AshkanAliabadi
Differential Revision: D23232809
Pulled By: IvanKobzarev
fbshipit-source-id: 11b070b6e082bac72e21dd4c25c9c675bbc8c4a3
