onnxruntime
34b6cd6d - MatMulIntToFloat Enable FP16 and update tensor ORT-DML indexing (#16871)

Commit
2 years ago
MatMulIntToFloat Enable FP16 and update tensor ORT-DML indexing (#16871) MatMulIntegerToFloat Enable FP16 and update tensor ORT-DML indexing ``` .\onnxruntime_test_all.exe --gtest_filter="*MatMulIntegerToFloat*" Note: Google Test filter = *MatMulIntegerToFloat* [==========] Running 13 tests from 4 test suites. [----------] Global test environment set-up. [----------] 1 test from CPU_U8S8_Precision_Tests [ RUN ] CPU_U8S8_Precision_Tests.MatMulIntegerToFloat [ OK ] CPU_U8S8_Precision_Tests.MatMulIntegerToFloat (35 ms) [----------] 1 test from CPU_U8S8_Precision_Tests (35 ms total) [----------] 1 test from GraphTransformationTests [ RUN ] GraphTransformationTests.MatMulIntegerToFloatTest [ OK ] GraphTransformationTests.MatMulIntegerToFloatTest (5 ms) [----------] 1 test from GraphTransformationTests (5 ms total) [----------] 1 test from QDQTransformerTests [ RUN ] QDQTransformerTests.MatMulIntegerToFloat [ OK ] QDQTransformerTests.MatMulIntegerToFloat (24 ms) [----------] 1 test from QDQTransformerTests (24 ms total) [----------] 10 tests from MatMulIntegerToFloat [ RUN ] MatMulIntegerToFloat.HasZeroPoint_NoBias_test_U8X8_FP16 2023-07-27 16:45:13.1564552 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:13.3115187 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:13.4173384 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:13.5232503 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:13.6350011 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:13.7389236 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:13.8479674 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:13.9661708 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. [ OK ] MatMulIntegerToFloat.HasZeroPoint_NoBias_test_U8X8_FP16 (951 ms) [ RUN ] MatMulIntegerToFloat.NoZeroPoint_HasBias_test_U8X8_FP16 2023-07-27 16:45:14.1087648 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:14.2124719 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:14.3137829 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:14.4173078 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:14.5223567 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:14.6240616 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:14.7247578 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:14.8346170 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. [ OK ] MatMulIntegerToFloat.NoZeroPoint_HasBias_test_U8X8_FP16 (830 ms) [ RUN ] MatMulIntegerToFloat.HasZeroPoint_NoBias_test_S8S8_FP16 2023-07-27 16:45:14.9395745 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:15.0389962 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:15.1365449 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:15.2336207 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. [ OK ] MatMulIntegerToFloat.HasZeroPoint_NoBias_test_S8S8_FP16 (393 ms) [ RUN ] MatMulIntegerToFloat.NoZeroPoint_HasBias_test_S8S8_FP16 2023-07-27 16:45:15.3304154 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:15.4340044 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:15.5331474 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. 2023-07-27 16:45:15.6337272 [W:onnxruntime:Default, base_tester.cc:763 onnxruntime::test::BaseTester::ExecuteModelForEps] registered execution providers CPUExecutionProvider were unable to run the model. [ OK ] MatMulIntegerToFloat.NoZeroPoint_HasBias_test_S8S8_FP16 (403 ms) [ RUN ] MatMulIntegerToFloat.HasZeroPoint_NoBias_test_U8X8 [ OK ] MatMulIntegerToFloat.HasZeroPoint_NoBias_test_U8X8 (739 ms) [ RUN ] MatMulIntegerToFloat.NoZeroPoint_HasBias_test_U8X8 [ OK ] MatMulIntegerToFloat.NoZeroPoint_HasBias_test_U8X8 (756 ms) [ RUN ] MatMulIntegerToFloat.HasZeroPoint_NoBias_test_S8S8 [ OK ] MatMulIntegerToFloat.HasZeroPoint_NoBias_test_S8S8 (363 ms) [ RUN ] MatMulIntegerToFloat.NoZeroPoint_HasBias_test_S8S8 [ OK ] MatMulIntegerToFloat.NoZeroPoint_HasBias_test_S8S8 (368 ms) [ RUN ] MatMulIntegerToFloat.MatMulInteger_With_ZeroPoint [ OK ] MatMulIntegerToFloat.MatMulInteger_With_ZeroPoint (11 ms) [ RUN ] MatMulIntegerToFloat.MatMulInteger_With_ZeroPoint_FP16 [ OK ] MatMulIntegerToFloat.MatMulInteger_With_ZeroPoint_FP16 (11 ms) [----------] 10 tests from MatMulIntegerToFloat (4833 ms total) [----------] Global test environment tear-down [==========] 13 tests from 4 test suites ran. (4914 ms total) [ PASSED ] 13 tests. ```
Author
Parents
Loading