vllm
[TPU] Support sliding window and logit soft capping in the paged attention kernel for TPU.
#15732
Merged
Merged
[TPU] Support sliding window and logit soft capping in the paged attention kernel for TPU. #15732
robertgshaw2-redhat
merged
8 commits into
vllm-project:main
from
vanbasten23:xiowei/sw_logit_cap
yaochengji
commented
on 2025-04-01
yaochengji
approved these changes
on 2025-04-02
NickLucche
approved these changes
on 2025-04-02
bvrockwell
requested changes
on 2025-04-02
vanbasten23
changed the title
bvrockwell
approved these changes
on 2025-04-02
robertgshaw2-redhat
approved these changes
on 2025-04-03
add sliding window and logit soft capping
ad5a0942
add test
e8188ab6
Add test for the sliding window and logit softcapping
967ea6df
fix the test faster the rebase.
b838faba
adding test for gemma
de1b347b
fix the ci
497be2cb
fix linter
7af49a16
fix comment
352fa122
disabled auto-merge 327 days ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
Reviewers
Assignees
No one assigned
Labels
tpu
ready
ci/build
v1
Milestone
No milestone
Login to write a write a comment.
Login via GitHub