vllm
bugfix(flashinfer,dcp): remove kv_cache_layout for BatchDCPPrefillWrapper._new_tokens.
#38895
Merged

Commits
  • bugfix(flashinfer,dcp): remove kv_cache_layout for BatchDCPPrefillWrapper._new_tokens.
    pisceskkk committed 53 days ago
  • Merge branch 'main' into dcp/hnd
    pisceskkk committed 15 days ago
Loading