Clamp derived sequence lengths and KV-cache index in CUDA GroupQueryAttention #29240
Clamp derived sequence lengths and KV-cache index in CUDA GroupQueryA…
30f11f6b
Fix CUDA GQA cache-append test: size present_kv via initializer total…
cd70bc37
Assert shape (not finiteness) for malformed-seqlens_k CUDA GQA test
e33469eb
Drop unnecessary lambda capture in CUDA GQA test verifier
77287e1d
Clarify why the malformed-seqlens_k CUDA GQA test verifies shape only
282d7003
jiafatom
merged
eade9ea9
into main 16 days ago
jiafatom
deleted the jiafatom/gqa-cache-index-bounds branch 16 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub