llama.cpp
ce1dded8 - remove unneeded scratch buffer from FP8 cpu cpy/dup path

Commit

19 hours ago

remove unneeded scratch buffer from FP8 cpu cpy/dup path

References

#27512 - Quant: OCP FP8 E4M3 support

#28392 - Add FP8 KV-cache support

#28413 - CUDA: Add OCP FP8 support

#28898 - ggml: support quant scales for fp8 and nvfp4

#29791 - vulkan: add fp8 and scaled matmul support

Author

ORippler

ORippler

Committer

ORippler

ORippler

Parents

Loading