ggml-org/llama.cpp

Pull Requests Commits
Update gguf-py/gguf/scripts/gguf_convert_endian.py
ORippler committed 8 days ago
6f53ba82
Extract FP8 tests from llama-arch to its own test-fixture
ORippler committed 8 days ago
9acf4473
LF line endings
ORippler committed 8 days ago
2505793e
Unmap lazy tensors before clean-up in Windows
ORippler committed 8 days ago
18ff3cca
Install all requirements also on Windows for behavior-check
ORippler committed 8 days ago
31049c8c
Move mixed compressed-tensor logic into dequant_fp8 + add unit-tests for it
ORippler committed 8 days ago
52f0c048
Apply batched suggestions from code review
ORippler committed 8 days ago
17df3983
Move test_conversion_fp8.py test execution to behavior-check.yaml
ORippler committed 8 days ago
1ec1aecf
Allow output scale tensors to be located in any gguf shard
ORippler committed 8 days ago
e2ec2a70
Leave fast-FP8 CPU on RISC-V for follow-up
ORippler committed 8 days ago
f0c6caa9
Relax numeric precision constraints for pre-check
ORippler committed 8 days ago
52708293
Fix kaleidai unit-test failures
ORippler committed 8 days ago
32dff68e
Fix python type checks
ORippler committed 8 days ago
69c13d6a
Make mandatory-F32 rules apply to FP8 during conversion
ORippler committed 8 days ago
dd35612e
Enable tied weights with shared scales
ORippler committed 8 days ago
3b8c645a
Fix remaining gaps
ORippler committed 8 days ago
cc572673
Conversion fixes
ORippler committed 8 days ago
6095b9a7
Add fast CPU kernel for F8_E4M3
ORippler committed 8 days ago
2eb5e76b
Fix lint + execute tests
ORippler committed 8 days ago
a532b97e
Adjust indents
ORippler committed 8 days ago
d124cf97
Blacklist fp8 in metal backend instead of white-list
ORippler committed 8 days ago
2dfa62ec
Defer weight materialization during conversion
ORippler committed 8 days ago
43a09ddc
Fix more conversion bugs
ORippler committed 8 days ago
6ba67406
Whitelist ggml_op_get_rows in metal instead of blacklisting
ORippler committed 8 days ago
c6e02857
Add dedicated encoder and decoder tests for FP8
ORippler committed 8 days ago
949e2fbd
add explanatory comments and TODOs
ORippler committed 8 days ago
291f0ac4
remove unneeded scratch buffer from FP8 cpu cpy/dup path
ORippler committed 8 days ago
f0046231
Add supported for strided copies to/from FP8 in CPU
ORippler committed 8 days ago
e16593d4
More FP8 conversion fixes
ORippler committed 8 days ago
f0c24471
Emit warnings when not fusing FP8 during conversion
ORippler committed 8 days ago
e798cfe5
Terms Of Use Privacy Policy Refund Policy Impressum