onnxruntime
FP16 inference performance improvement on CPU
#25680
Merged
Overview
Commits
20
Changes
View On GitHub

FP16 inference performance improvement on CPU #25680

hariharans29 merged 20 commits into microsoft:main from nikhilfujitsu:fp16_infr
nikhilfujitsu
nikhilfujitsu
Rohanjames1997
abhijain1204fujitsu
Rohanjames1997
nikhilfujitsu
hariharans29
azure-pipelines
hariharans29 hariharans29 closed this 126 days ago
hariharans29 hariharans29 reopened this 126 days ago
hariharans29 hariharans29 requested a review from edgchen1 edgchen1 126 days ago
hariharans29 hariharans29 assigned hariharans29 hariharans29 126 days ago
hariharans29 hariharans29 unassigned hariharans29 hariharans29 126 days ago
hariharans29 hariharans29 requested a review from hariharans29 hariharans29 126 days ago
nikhilfujitsu nikhilfujitsu force pushed from 70898bbf to 69d83bfb 124 days ago
nikhilfujitsu
edgchen1
edgchen1 commented on 2025-09-02
nikhilfujitsu nikhilfujitsu force pushed from 69d83bfb to 888d47c7 110 days ago
nikhilfujitsu
edgchen1
edgchen1 commented on 2025-09-15
edgchen1
edgchen1 commented on 2025-09-15
nikhilfujitsu
hariharans29
nikhilfujitsu
edgchen1
edgchen1 commented on 2025-09-17
edgchen1
edgchen1 commented on 2025-09-17
nikhilfujitsu nikhilfujitsu force pushed from cc4defa9 to 2a722360 97 days ago
edgchen1
edgchen1 commented on 2025-09-23
nikhilfujitsu nikhilfujitsu force pushed from 2a722360 to 94ef7086 97 days ago
nikhilfujitsu nikhilfujitsu force pushed from 1dd88bf8 to f4afb107 97 days ago
github-advanced-security
github-advanced-security commented on 2025-09-23
github-advanced-security
github-advanced-security commented on 2025-09-23
edgchen1
azure-pipelines
github-advanced-security
github-advanced-security commented on 2025-09-23
nikhilfujitsu
edgchen1
edgchen1 commented on 2025-09-24
nikhilfujitsu
edgchen1
azure-pipelines
nikhilfujitsu
hariharans29
nikhilfujitsu
edgchen1
edgchen1 commented on 2025-09-30
edgchen1
edgchen1 commented on 2025-09-30
edgchen1
hariharans29
nikhilfujitsu
edgchen1
edgchen1
azure-pipelines
nikhilfujitsu
hariharans29
hariharans29 commented on 2025-10-09
hariharans29
hariharans29 commented on 2025-10-09
hariharans29
hariharans29 commented on 2025-10-09
hariharans29
hariharans29 commented on 2025-10-09
hariharans29
azure-pipelines
nikhilfujitsu
nikhilfujitsu FP16 inference performance improvement on CPU
8352ae80
nikhilfujitsu Rebased
11ff2abd
nikhilfujitsu Fixup: Minor fixups
f43c1c0a
nikhilfujitsu Minor fixups
aec86817
nikhilfujitsu Minor Fixup
89d1ceda
nikhilfujitsu Added Constant Folding Float16 regression test for TopK
18be2133
nikhilfujitsu Added the script to generate constant_float16_topk.onnx
10f58674
nikhilfujitsu CI Fixes.
00d8a3c9
nikhilfujitsu CI Fixup.
4c1ebf97
nikhilfujitsu Bot suggestion Fixup.
7487208b
nikhilfujitsu Apply suggestion from @edgchen1
9623de59
nikhilfujitsu CI Fixup
d701bdf4
nikhilfujitsu Fixup: Erf<Mlfloat16> updated with temp allocater.
db5fc697
nikhilfujitsu Added a test for the MLFloat16 Erf
cbf359a7
nikhilfujitsu nikhilfujitsu force pushed from 4f238652 to cbf359a7 75 days ago
nikhilfujitsu Minor Fixup
7ce72e66
nikhilfujitsu Fixup
1f8793f3
nikhilfujitsu Clean Up
10407dbc
nikhilfujitsu
hariharans29
azure-pipelines
hariharans29
hariharans29 commented on 2025-10-17
edgchen1
edgchen1 commented on 2025-10-17
nikhilfujitsu Fixup: Reduction in use of narrow casting
cab68c5f
nikhilfujitsu
hariharans29
hariharans29
hariharans29 commented on 2025-10-19
hariharans29
hariharans29 commented on 2025-10-19
nikhilfujitsu Fixup
094812f1
nikhilfujitsu
nikhilfujitsu CI fixes
f7ba2240
edgchen1
edgchen1 approved these changes on 2025-10-24
hariharans29
azure-pipelines
hariharans29
hariharans29 approved these changes on 2025-10-24
hariharans29 hariharans29 merged 42869cac into main 66 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum