openvino
0d51dfbf - Add condition for Matmul and Select in ClampFP16OutputSoftmaxMatcher (#31798)

Commit
256 days ago
Add condition for Matmul and Select in ClampFP16OutputSoftmaxMatcher (#31798) ### Description of the issue - symptom: audio output file is invalid. (Empty audio file) Output file of fp32 inference sounds fine. - root-cause: Matmul layer generated 'inf' value to output <img width="1500" height="598" alt="image" src="https://github.com/user-attachments/assets/17b13ca8-0f47-47c4-8c3c-6076635241ce" /> intermediate buffer comparison with fp32 inference : <html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta name=ProgId content=OneNote.File> <meta name=Generator content="Microsoft OneNote 15"> </head> <body lang=en-US style='font-family:Calibri;font-size:11.0pt'> <!--StartFragment--> <div style='direction:ltr'> Dst0 | data1 shape: [1, 2, 1, 411, 411] data2 shape: [1, 2, 1, 411, 411] Number of items: 337842 / 337842 Max value: inf / 738612.875 Min value: -inf / -1369326.500 Max per-pixel diff: inf Total per-pixel diff: inf Average per-pixel diff: inf Total sign diff: 232 -- | -- Src1 | data1 shape: [1, 2, 1, 96, 411] data2 shape: [1, 2, 1, 96, 411] Number of items: 78912 / 78912 Max value: 529.000 / 527.687 Min value: -523.500 / -522.751 Max per-pixel diff: 3.043 Total per-pixel diff: 18146.697 Average per-pixel diff: 0.230 Total sign diff: 19 Src2 | data1 shape: [1, 2, 1, 411, 411] data2 shape: [1, 2, 1, 411, 411] Number of items: 337842 / 337842 Max value: 295.500 / 296.001 Min value: -281.250 / -281.503 Max per-pixel diff: 0.920 Total per-pixel diff: 611.090 Average per-pixel diff: 0.002 Total sign diff: 1 Src0 | data1 shape: [1, 2, 1, 411, 96] data2 shape: [1, 2, 1, 411, 96] Number of items: 78912 / 78912 Max value: 58.031 / 58.034 Min value: -58.031 / -57.976 Max per-pixel diff: 0.251 Total per-pixel diff: 1893.853 Average per-pixel diff: 0.024 Total sign diff: 44 </div> <!--EndFragment--> </body> </html> ACTIVATIONS_SCALE_FACTOR did not work for this case. - how resolved: Add matching case of Select layer to a matcher of ClampFP16OutputSoftmaxMatcher to prevent 'inf' value propagated through softmax #### The code and line that caused this issue - Accuracy issue : Missing logic to prevent 'inf' value passed to softmax #### Reproduction step and snapshot - Execute openvino notebooks/openvoice2-and-melotts #### Checklist - [x] Is it a proper fix? (not a workaround) - [x] Did you include test case for this fix, if necessary? - [x] Did you review existing test that can be extended to cover this scenario? Which test did you review? : reviewed unittests with "ClampFp16OutputTest" ### Tickets: - CVS-169046 Signed-off-by: Min, Byungil <byungil.min@intel.com>
Author
Parents
Loading