vllm
66b58402 - [Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783)
Commit
View On GitHub
Commit
144 days ago
[Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783) Signed-off-by: vensen <vensenmu@gmail.com> Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Author
Flink-ddd Flink-ddd
Parents
82c795d6
FAQ Terms Privacy Refunds Impressum
Loading