vllm
01a55941 - [Docs] Update FP8 KV Cache documentation (#12238)

Commit
1 year ago
[Docs] Update FP8 KV Cache documentation (#12238) Signed-off-by: mgoin <michael@neuralmagic.com> Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Author
Parents
Loading