transformers
edeca438 - 🚨 Support dequantization for most GGML types (#32625)

Commit
1 year ago
🚨 Support dequantization for most GGML types (#32625) * use gguf internal dequantize * add Q5_0 test * add iq1 test * add remained test * remove duplicated test * update docs * add gguf version limit * make style * update gguf import catch * revert vocab_size patch * make style * use GGUF_MIN_VERSION everywhere
Author
Parents
Loading