ggml-org/llama.cpp

Pull Requests Commits

adapt TQ1_0 changes

0cc4m committed 1 day ago

b363e78c

0cc4m committed 1 day ago

2bf04587

fix fp4 extension use switch being overwritten by generic shader

0cc4m committed 1 day ago

0a3b62bb

simplify cm2 code with single uint8_t buffer

0cc4m committed 1 day ago

38100eb8

revert iq shmem table renames

0cc4m committed 1 day ago

334eb553

split out q4_k/q5_k cm2 shader to fix Ampere regression

0cc4m committed 1 day ago

a70003a4

restore coopmat2 q4_k/q5_k optimization

0cc4m committed 1 day ago

9bbc1f23

0cc4m committed 1 day ago

1b15e4cf

remove LUT quants from unified shader

0cc4m committed 1 day ago

6865f98c

vulkan: use spec constant for mul mat type_a

0cc4m committed 1 day ago

db2d7cda

vulkan: add TQ1_0 support (mm, mat-vec, mat-vec-id, dequant, get_rows) (#27765)

Anjielon committed 1 day ago

Verified 8fe90e1f

convert : add `--fuse-qkv` flag to fuse Q/K/V into QKV during HF-to-GGUF conversion (#22780)

JoursBleu committed 2 days ago

Verified 465e49b9

models : fix GDN normalization from `max` to `rsqrt` (#28068)

danielhanchen committed 2 days ago

Verified 5fdfa628

[Model] Support for Spark2_5ForCausalLM implementation (#27868)

KnightYao committed 2 days ago

Verified 3ad1ba73

opencl: properly choose weights pack for q4_K, q5_K mul_mat (#28402)

lhez committed 2 days ago

Verified d03efa5d

cuda: fixes races in mmid and mmf (#28475)

am17an committed 2 days ago

Verified 73a43d1f

grammar : fix max repetition threshold (#28469)

aldehir committed 2 days ago

Verified 9e0e2205

ui: Improve Chat Messages rendering performance (#28460)

allozaur committed 2 days ago

Verified 0afb805b

common: add --log-jsonl (#28437)

ngxson committed 2 days ago

Verified 7620399f

ui : embed assets directly with CMake (#28445)

angt committed 2 days ago

Verified c457e3bf

metal : add remaining fa-vec tunings for M2 Max (#28458)

nikwen committed 2 days ago

Verified 971595d6

Github: limit blank issues to maintainers (#28435)

JohannesGaessler committed 3 days ago

Verified 74a7c897

metal : fix memory leak in early return (#28399)

nikwen committed 3 days ago

Verified 6a1a922d

sycl : fix test-backend-ops CI break && restore Kronecker product FWHT support (#28016) (#28254)

philip-jingxin committed 3 days ago

Verified 4d917609

sycl: attribute device allocations by site (GGML_SYCL_MEMTRACE) (#27631)

nicois committed 3 days ago

Verified cd8cdf39

metal : add remaining fa-vec tunings for M3 (#28396)

init-22 committed 4 days ago

Verified 427291b5

ui : fix MCP image attachments not displayed in tool block (#25789) (#28089)

nachobh committed 4 days ago

Verified 85d5703a

opencl: extend the elementwise and data‐movement op coverage (#27633)

wanghqc committed 4 days ago

Verified 1548a240

opencl: add Adreno xmem SDPA path (#26331)

happyyzy committed 4 days ago

Verified 4acf4a4c

ci : move more jobs to ccache-buckets (#28375)

CISC committed 4 days ago

Verified 8b4b3558

Older