vllm
[Spec Decode] Update extract_hidden_states to use deferred kv_connector clear
#37013
Merged
Overview
Commits
6
Changes
View On GitHub
Commits
  • Update extract_hidden_states to deferred kv_connector clear
    fynnsu committed 143 days ago
  • Patch bug in ExampleHiddenStatesConnector that causes occasional crashes
    fynnsu committed 143 days ago
  • lint
    fynnsu committed 143 days ago
  • fix docstring
    fynnsu committed 143 days ago
  • fix missing attribute
    fynnsu committed 143 days ago
  • fix shape mismatch
    fynnsu committed 143 days ago
FAQ Terms Privacy Refunds Impressum
Loading