onnxruntime
Fix wrong percentile values returned during calibration
#10847

Merged

Fix wrong percentile values returned during calibration #10847

yufenglee merged 6 commits into microsoft:master from mfuntowicz:percentiles_fix_asymmetric

Use numpy.percentile to get the lookup value.

2a0cfff8

Use 1.0 as float value rather than integer.

cfdc5619

Add missing cdf parameter for `np.percentile`.

f8168c4e

Use 100. instead of 1.0

2cbed173

Remove print.

fa4fe7ef

yufenglee commented on 2022-03-11

yufenglee requested a review from

chilo-ms 4 years ago

yufenglee added release:1.11

Update from @yufenglee

57483b82

yufenglee approved these changes on 2022-03-11

yufenglee merged c4f73af2 into master 4 years ago

mfuntowicz deleted the percentiles_fix_asymmetric branch 4 years ago

faxu added triage:approved

Reviewers

yufenglee

chilo-ms

Assignees

No one assigned

Labels

None yet

Milestone

No milestone