Measure Dynamo cache latency lookup (#121604)
Summary:
X-link: https://github.com/pytorch/pytorch/pull/121604
Approved by: https://github.com/jansel
ghstack dependencies: #121614, #121622
Reviewed By: osalpekar
Differential Revision: D54875725
Pulled By: anijain2305
fbshipit-source-id: d8cd464d3bf889f5cbcd64192f3c498da163c066
