PR #12238 [Docs] Update FP8 KV Cache documentation

[Docs] Update FP8 KV Cache documentation #12238

DarkLight1337 merged 6 commits into vllm-project:main from neuralmagic:updated-kv-cache-quant-docs

Update FP8 KV Cache documentation

f99c3e99

mergify added documentation

Improvements

aadb3c2d

Example

2e8b036e

DarkLight1337 commented on 2025-01-21

Update docs/source/features/quantization/quantized_kvcache.md

60157def

DarkLight1337 approved these changes on 2025-01-21

DarkLight1337 commented on 2025-01-21

Update quantized_kvcache.md

5598c2f3

DarkLight1337 commented on 2025-01-22

Update docs/source/features/quantization/quantized_kvcache.md

cca9fe04

mgoin added ready

DarkLight1337 merged 01a55941 into main 1 year ago

Reviewers

DarkLight1337

Assignees

No one assigned

Labels

documentation ready

Milestone

No milestone