vllm
0ecdd980
- Add comments on accessing `kv_cache` and `attn_metadata` (#13887)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
296 days ago
Add comments on accessing `kv_cache` and `attn_metadata` (#13887) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
References
#13887 - Add comments on accessing `kv_cache` and `attn_metadata`
Author
hmellor
Parents
7b700ec8
Loading