vllm
863d315c
- [V1][TPU] Pad the block_table.shape[1] so the ragged paged attention can handle correctly (#14597)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
[V1][TPU] Pad the block_table.shape[1] so the ragged paged attention can handle correctly (#14597)
References
#14597 - [V1][TPU] Pad the block_table.shape[1] so the ragged paged attention can handle correctly
Author
vanbasten23
Parents
d374f04a
Loading