llama.cpp
[CUDA] Reduce the number of stream-k blocks to reduce the overhead of the flash_attn_stream_k_fixup kernel
#21086
Closed

Commits
  • Reduce the number of stream-k blocks to reduce the overhead of the flash_attn_stream_k_fixup kernel
    gaugarg-nv committed 12 days ago
  • Fix compilation error
    gaugarg-nv committed 12 days ago
  • Remove trailing whitespace
    gaugarg-nv committed 12 days ago
Loading