benchmark
e1ea05bc - Populate hit/miss cache counts for both FXGraph and AOTAutograd caches (#171743)

Commit
42 days ago
Populate hit/miss cache counts for both FXGraph and AOTAutograd caches (#171743) Summary: We have an internal request to add logging for all remote/local cache hits/misses for both FXGraph cache and AOTAutograd cache. Currently, we only have remote FXGraph counters. Interpreting the counters could be tricky, e.g., because an AOTAutograd hit also involves an FXGraph hit. But I guess we at least populate the data and figure that out as needed. Both caches leverage `find_guarded_entry()` as the low-level method that knows about whether we're consulting a remote vs. local cache so I added the logging there via a new class method that both caches implement to bump the appropriate counters. Testing: * New unit tests to mock log_compilation_event and check hit/miss counts with various config settings. * Internal logging for nanogpt (torchbench). -- first run (misses): https://fburl.com/scuba/dynamo_compile/sandbox/yta2o694 -- second run (hits): https://fburl.com/scuba/dynamo_compile/sandbox/orb561zi X-link: https://github.com/pytorch/pytorch/pull/171743 Approved by: https://github.com/oulgen Reviewed By: atalman, jeanschmidt Differential Revision: D90223373 fbshipit-source-id: e85dc6a3abd6872f94d25a5d71cb23fdf712e34d
Author
Committer
Parents
Loading