[vulkan][asan] Fix Invalid Memory ops (#41224)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/41224
Test Plan: Imported from OSS
Reviewed By: AshkanAliabadi
Differential Revision: D22754940
Pulled By: IvanKobzarev
fbshipit-source-id: f012b78a57f5f88897b2b6b91713090c8984a0bc
