onnxruntime
8d5ecc4d - [Quantization] Fix scale/zero-point for 16-bit QDQ Softmax (#18589)

Commit
2 years ago
[Quantization] Fix scale/zero-point for 16-bit QDQ Softmax (#18589) ### Description Sets the appropriate scale and zero-point values for 16-bit QDQ Softmax. Previously, the scale/zp were set to fixed values that were specific to 8-bit quantization. ### Motivation and Context Generate more accurate 16-bit QDQ models that contain Softmax.
Parents
Loading