llama.cpp
16b9cd19 - Convert vector to f16 for dequantize mul mat vec (#1913)

Commit
2 years ago
Convert vector to f16 for dequantize mul mat vec (#1913) * Convert vector to f16 for dmmv * compile option * Added compilation option description to README * Changed cmake CUDA_ARCHITECTURES from "OFF" to "native"
Parents
Loading