Ensure device arg is passed to test_transformers (#100260)
# Summary
Follow up to #100121 to actually make sure that test functions are accepting a device arg as input.
Pull Request resolved: https://github.com/pytorch/pytorch/pull/100260
Approved by: https://github.com/malfet, https://github.com/ngimel