pytorch
64d605ba - [Static Runtime] Added caching for the NNC code generated for Logit. (#63840)

Commit
3 years ago
[Static Runtime] Added caching for the NNC code generated for Logit. (#63840) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/63840 Added NNC generated code for Logit to the cache. ``` Logit NNC Benchmark Time (ns) w/o cache w/ cache logit_nnc_sleef/64 543 536 logit_nnc_sleef/512 3517 3465 logit_nnc_sleef/8192 88483 85881 logit_nnc_sleef/32768 337016 323090 logit_nnc_fast/64 167 163 logit_nnc_fast/512 866 817 logit_nnc_fast/8192 13069 12801 logit_nnc_fast/32768 53429 52530 logit_nnc_vml/64 164 151 logit_nnc_vml/512 783 769 logit_nnc_vml/8192 11563 11674 logit_nnc_vml/32768 46720 46452 ``` Test Plan: Unit tests and inline_cvr model. Reviewed By: hlu1 Differential Revision: D30405424 fbshipit-source-id: 938b1b74758e2612ae151bac890c5f8ebbc42d50
Author
Parents
Loading