llama.cpp
5f939498 - ggml : unit test for quantization functions (#953)

Commit
2 years ago
ggml : unit test for quantization functions (#953) * Unit test for quantization functions Use the ggml_internal_get_quantize_fn function to loop through all quantization formats and run a sanity check on the result. Also add a microbenchmark that times these functions directly without running the rest of the GGML graph. * test-quantize-fns: CI fixes Fix issues uncovered in CI - need to use sizes divisible by 32*8 for loop unrolling - use intrinsic header that should work on Mac * test-quantize: remove Per PR comment, subsumed by test-quantize-fns * test-quantize: fix for q8_0 intermediates
Author
Parents
  • tests
    • File
      CMakeLists.txt
    • File
      test-quantize-fns.cpp
    • File
      test-quantize-perf.cpp
    • File
      test-quantize.c