llama.cpp
966baae7 - vulkan: handle mul_mat_id duplicates in the prepass rather than looping (#29998)

Commit
17 days ago
vulkan: handle mul_mat_id duplicates in the prepass rather than looping (#29998) * vulkan: compute every row of an expert in mul_mm_id when ids repeat * vulkan: handle mul_mat_id duplicates in the prepass rather than looping Extend the "hoist row ids" optimization to always be enabled and to emit a compact list of tile descriptions that need to run, and to emit multiple tiles when needed. Then we can launch a tighter upper bound on the number of workgroups and the tail can trivially early exit. --------- Co-authored-by: Anjielon <[EMAIL_REDACTED]>
Author
Parents
Loading