pytorch
f08ddae8 - [quant][pt2e] Change input act annotation to a map and allow dynamic quantization for non zeroth argument (#101005)

Commit
1 year ago
[quant][pt2e] Change input act annotation to a map and allow dynamic quantization for non zeroth argument (#101005) Summary: Previously the node annotation looks like the following: ``` node.meta["..."] = { "input_act_obs_or_fq_ctr": ..., "weight_obs_or_fq_ctr": ..., "weight_index": 1, } ``` Basically we need specifiy the index for weight and also have a separate key for weight config, in this PR we changed that to: ``` node.meta["..."] = { "input_act_obs_or_fq_ctr_map": {input_node: ..., weight_node: ...}, } ``` This can support specifying the observer/fake quant constructor for any argument of the node Test Plan: buck2 test @//mode/opt //caffe2/test:quantization_pt2e -- --exact 'caffe2/test:quantization_pt2e - test_resnet18_with_quantizer_api (quantization.pt2e.test_quantize_pt2e.TestQuantizePT2EModels)' Reviewed By: kimishpatel Differential Revision: D45553195 Pull Request resolved: https://github.com/pytorch/pytorch/pull/101005 Approved by: https://github.com/kimishpatel
Author
Committer
Parents
Loading