vllm
[Perf] Remove blocking copy in GDN Attention
#31167
Merged

[Perf] Remove blocking copy in GDN Attention #31167

benchislett
benchislett make copy non blocking
95ce8410
benchislett benchislett requested a review from LucasWilkinson LucasWilkinson 1 day ago
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2025-12-22
mgoin mgoin added performance
mgoin mgoin added ready
benchislett Merge branch 'main' into qwen3-next-async
cdef87f1
mgoin
mgoin approved these changes on 2025-12-22
vllm-bot vllm-bot merged 85aff45e into main 1 day ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone