vllm
[MISC] Disable chunked prefill with fp8 kv-cache
#7185
Closed

[MISC] Disable chunked prefill with fp8 kv-cache #7185

comaniac
comaniac [MISC] Disable chunked prefill with fp8 kv-cache
bd1fd4ea
comaniac comaniac requested a review from WoosukKwon WoosukKwon 1 year ago
github-actions
jon-chuang
comaniac
jon-chuang
comaniac
jon-chuang
comaniac comaniac closed this 1 year ago
comaniac comaniac deleted the disable-chunked-prefill-w-fp8-kv-cache branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone