vllm
[Bugfix][ROCm] Use `chunked_prefill_paged_decode` as fallback for V1 attention on ROCm
#18093
Merged

Commits
  • fallback v1 FA to chunked_prefill_paged_decode
    kliuae committed 1 year ago
  • fallback v1 FA to chunked_prefill_paged_decode
    kliuae committed 1 year ago
Loading