llama.cpp
hexagon: add LIGHTNING_INDEXER support
#31289
Merged
Overview
Commits
13
Changes
View On GitHub

hexagon: add LIGHTNING_INDEXER support #31289

max-krasnyansky merged 13 commits into ggml-org:master from qualcomm:tb/hexagon-lightning-indexer
tboinovski1
github-actions github-actions added testing
github-actions github-actions added ggml
github-actions github-actions added Hexagon
tboinovski1 tboinovski1 force pushed from 94a6f551 to 6ce65d27 9 days ago
tboinovski1 tboinovski1 force pushed from 6ce65d27 to d4cd99d3 8 days ago
tboinovski1 tboinovski1 force pushed from 419d25c6 to c322b0a1 8 days ago
tboinovski1 hexagon: initial support for LIGHTNING_INDEXER op
38f7809c
tboinovski1 hex-lght-idxr: hmx for prefill
15375337
tboinovski1 hex-lght-idxr: q8_0 decode gather transpose, two-block decode compute
d88768a3
tboinovski1 hex-lght-idxr: pipelined hmx path for decode and prefill
83b11351
tboinovski1 hex-lid: add support for K (f32)
e8a0c9f7
tboinovski1 hex-lid: add support for K (f32)
2e5adc40
tboinovski1 hex-lid: add support for q4_0
cb57d4a9
tboinovski1 hex-lid: remove scalar VTCM reads in the HMX q4_0 K prep and remove v…
fe4cd55d
tboinovski1 hex-lid: host/kernel kparams alighnment and remove sw devices in kernel
2beff6f1
max-krasnyansky max-krasnyansky force pushed from c322b0a1 to 2beff6f1 2 days ago
max-krasnyansky hex-lit: update dma pipeline to use canonical dbl buffering in all paths
2515d1ed
max-krasnyansky hex-lit: add GGML_HEXAGON_LI_SELECT to force hmx/hvx paths
29566c19
max-krasnyansky hex-lit: add support for dims collapse
7f874170
max-krasnyansky max-krasnyansky marked this pull request as ready for review 2 days ago
max-krasnyansky max-krasnyansky requested a review from ggerganov ggerganov 2 days ago
max-krasnyansky max-krasnyansky requested a review 2 days ago
lhez
lhez approved these changes on 2026-11-04
max-krasnyansky hex-lit: make kparams constistent with other ops
7b359962
max-krasnyansky max-krasnyansky force pushed from 25b70d6d to 7b359962 2 days ago
max-krasnyansky
max-krasnyansky approved these changes on 2026-11-04
max-krasnyansky
lhez
lhez approved these changes on 2026-11-04
max-krasnyansky max-krasnyansky merged bee23322 into master 2 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
testing ggml Hexagon
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum