pytorch
fc1105b2 - [inductor] Implement Fx graph caching to improve warm compilation time. (#103453)

Commit
1 year ago
[inductor] Implement Fx graph caching to improve warm compilation time. (#103453) Summary: Implement an on-disk cache to save and reuse compiled FX Graphs. This implementation does not handle tensors with symbolic shapes. This needs to be done in a follow-up PR. Test Plan: * New unit tests exercising saving and load from the cache. * New unit tests to exercise the cache key calculations. * Ran several benchmarks to see cache hit and resulting compilation times. Pull Request resolved: https://github.com/pytorch/pytorch/pull/103453 Approved by: https://github.com/eellison, https://github.com/Chillee
Author
Committer
Parents
Loading