llama.cpp

9d873d75 - test-model-random : shuffle across sequences but not within

test-model-random : shuffle across sequences but not within There isn't really a use-case for fully-shuffled batches * test-model-random : use F32 as the KV cache type Temporary until F16 is fixed on ARM when using FP16_VECTOR_ARITHMETIC