llama.cpp
vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows)
#27765
Merged

vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) #27765

0cc4m merged 8 commits into ggml-org:master from Anjielon:vulkan-tq1_0
Anjielon
Anjielon Anjielon requested a review from ggerganov ggerganov 52 days ago
Anjielon Anjielon requested a review 52 days ago
github-actions github-actions added testing
github-actions github-actions added Vulkan
github-actions github-actions added ggml
ggml-gh-bot
ggml-gh-bot ggml-gh-bot added draft
github-actions github-actions marked this pull request as draft 52 days ago
github-actions github-actions removed draft
Anjielon vulkan: add TQ1_0 support (mm, mat-vec, dequant, get_rows)
b40ca9cd
Anjielon Anjielon force pushed to b40ca9cd 52 days ago
jeffbolznv
jeffbolznv commented on 2026-08-26
Anjielon vulkan: pack TQ1_0 powers of 3 into a 32-bit constant
fe13151f
jeffbolznv
jeffbolznv commented on 2026-08-27
Anjielon vulkan: address review - shared TQ1_0 decode helpers, fix standalone …
0c0f5a08
Anjielon
Anjielon
Anjielon
jeffbolznv
jeffbolznv commented on 2026-08-28
Anjielon vulkan: address review — English comments, shared tq1_0_trit, trim TQ…
4c1f2334
Anjielon
jeffbolznv
jeffbolznv approved these changes on 2026-08-29
jeffbolznv
Anjielon Anjielon marked this pull request as ready for review 49 days ago
Anjielon
Anjielon Anjielon requested a review 49 days ago
github-actions github-actions added Apple Metal
Anjielon metal: decline TQ1_0 for GET_ROWS and mat-mul in supports_op
90154821
Anjielon Merge remote-tracking branch 'upstream/master' into vulkan-tq1_0
126b2b87
Anjielon Anjielon force pushed to 126b2b87 49 days ago
0cc4m
Anjielon vulkan: trim the TQ1_0 comments
b77534ba
Anjielon
0cc4m
0cc4m commented on 2026-08-31
Anjielon vulkan: address review — trim comments, fold Metal check, drop unused _v
910e11f1
Anjielon
Anjielon
0cc4m
0cc4m
0cc4m approved these changes on 2026-09-07
0cc4m 0cc4m merged 8fe90e1f into master 41 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone