[Perf] Reduce unnecessary ref count bumps (#72523)
Summary:
Pull Request resolved: https://github.com/pytorch/pytorch/pull/72523
`toTuple()` returns a new intrusive pointer that bumps its underlying ref count. Whereas, `toTupeRef` returns a reference. We can save an unnecessary ref count bump.
ghstack-source-id: 149173308
Test Plan: Sandcastle CI
Reviewed By: swolchok
Differential Revision: D34047666
fbshipit-source-id: 8c821e45f7af4f3f1d098871926b9df288e329fb
(cherry picked from commit 34797e508d533c578a40f74ffc82b34e1c3ea40e)
