Re-enable torchdeploy oss tests and move to per-PR cuda11 job (#58872)
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/58872
Test Plan: verify tests running on CI as expected
Reviewed By: suo
Differential Revision: D28646660
fbshipit-source-id: eb7d784844fb7bc447b4232e2f1e479d4d5aa72f
