llama.cpp
[CUDA] Reduce the number of stream-k blocks to reduce the overhead of the flash_attn_stream_k_fixup kernel
#21086
Closed
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
3
Changes
View On
GitHub
Commits
Reduce the number of stream-k blocks to reduce the overhead of the flash_attn_stream_k_fixup kernel
gaugarg-nv
committed
12 days ago
Fix compilation error
gaugarg-nv
committed
12 days ago
Remove trailing whitespace
gaugarg-nv
committed
12 days ago
Loading