llama.cpp
52202132 - hexagon: add conv2d support (#30995)

Commit
23 days ago
hexagon: add conv2d support (#30995) * hexagon: add conv2d op * hex-conv2d: add double-buffered staging * hex-conv2d: full 64-wide activation block transpose straight from staged buffer * hex-conv2d: implicit gemm * hex-conv2d: remove scalar path and kernel * hex-conv2d: unify conv2d kernel params for all paths * hex-conv2d: scale HMX result before f16 storage and then restore during unpacking to prevent overflow * hex-conv2d: fix f16 overflow in HMX paths * hex-conv2d: refactor to rebase to new op fusion machinery * hex-conv2d: restructure DMA pipelines and trace scopes * hex-conv2d: removed the HVX_WIDTH and HVX_TILED paths * hex-conv2d: remove in-loop vector spills * hex-conv2d: refactor kparams, vtcm-layout and dma-pipeline to match the other ops * hex-conv2d: add basic support for CONV_2D_DW Co-Authored-By: Pranav Dhinakar <pdhinaka@qti.qualcomm.com> * hex-conv_2d_dw: use DMA in all paths * hex-conv_2d_dw: support for chunking larger inputs * hex-conv_2d_dw: remove scalar/hvx access for w tensor (replaced with sync dma copy) * hex-conv-2d: fix warnings * hex-conv2d-dw: vectorize all paths * hex-conv-2d-dw: tree-based reductions and unrolling to optimize * hex-conv-2d-dw: uninline compute loops from dma loops * hex-conv-2d-dw: move all kernel selection into the host solver and simplify/specialize kernel dispatch * hex-softmax: update obsolete gates to enable SOFT_MAX for mmproj --------- Co-authored-by: Max Krasnyansky <maxk@qti.qualcomm.com> Co-authored-by: Pranav Dhinakar <pdhinaka@qti.qualcomm.com>
Author
Parents
Loading