llama.cpp
e50c254a - sycl: bound CONV_TRANSPOSE_1D input iteration (#31109)

Commit
1 day ago
sycl: bound CONV_TRANSPOSE_1D input iteration (#31109) Used angelX to optimize SYCL/drama 3 coordination, results are as follows Each output reads only inputs with i*s0 <= idx < i*s0 + K, in the same ascending order as before. Arc Pro B70, oneAPI 2026.1, test-backend-ops perf, base 9b56ccf00 vs patch, median of 3 same-boot A/B/A rounds, A/A 1.000-1.001: | input [ne0, ne1] | kernel [K, OC, IC] | s0 | base us | patch us | speedup | |---|---|---|---|---|---| | [16, 1536] | [16, 768, 1536] | 8 | 3910.57 | 1348.59 | 2.90x | | [128, 768] | [16, 384, 768] | 8 | 37735.00 | 1665.26 | 22.66x | | [1024, 384] | [8, 192, 384] | 4 | 270371.75 | 1471.74 | 183.71x | | [4096, 192] | [4, 96, 192] | 2 | 534614.63 | 752.74 | 710.23x | Shapes are the drama 3 codec decoder upsampling stack, added as perf cases. Chained 4-layer stack at 1/4/24 input frames: base 66.3/847.4/28638.5 ms, patch 2.3/6.7/30.7 ms. Kernel numbers, not end-to-end TTS latency. Correctness: test-backend-ops -o CONV_TRANSPOSE_1D 116/116 on base and patch, and 116/116 rebased on 3f03b1772. Seeded output dump (7.46 MB) byte-identical to base. Full test-backend-ops aborts on base and patch alike at the non-F32 SWIGLU_OAI assert (element_wise.cpp:1187, see #30857). With only those cases excluded: 20145/20173 on base and patch, and every patch-run failure also fails on base. Co-authored-by: Titaniumtown <titaniumtown@proton.me>
Author
Parents
Loading