text-generation-inference
0da4df4b - Fix FP8 KV-cache condition (#2611)

Login via GitHub
Home
Pricing
FAQ
Install

Login via GitHub

Commit

1 year ago

Fix FP8 KV-cache condition (#2611) Update kv_cache.py

References

#2611 - Fp8 Cache condition

Author

flozi00

flozi00

Parents

FAQ Terms Privacy Refunds Impressum

Loading