vllm
04bf5a35
- [Spec Decode] Update extract_hidden_states to use deferred kv_connector clear (#37013)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
13 hours ago
[Spec Decode] Update extract_hidden_states to use deferred kv_connector clear (#37013)
References
#37013 - [Spec Decode] Update extract_hidden_states to use deferred kv_connector clear
Author
fynnsu
Parents
43a73f85
Loading