ggerganov/llama.cpp

Pull Requests Commits

forforever73 committed 5 days ago

8045779c

abort on unknown KV type, single-source fa_vec_legal_ne

forforever73 committed 5 days ago

9be171f5

tools : document the Metal tuner, point the table comment at it

forforever73 committed 5 days ago

ff024685

test-backend-ops : replace the FA vec tune mode with a bounded (Q,NE) slice

forforever73 committed 5 days ago

26edf081

cool down and re-measure the dirty window on thermal drift

forforever73 committed 5 days ago

35c08cd0

tools : add FA-vec (Q,NE) sweep, compression and table emit

forforever73 committed 5 days ago

f44d2ee2

add FA-vec graph build + tensor init to the tuner

forforever73 committed 5 days ago

8e7831fd

add op-agnostic perf cell + median timing for the tuner

forforever73 committed 5 days ago

cf80ea68

add ggml-metal-tuning skeleton

forforever73 committed 5 days ago

55318e3b

add device id -> token lookup for the offline tuning tool

forforever73 committed 5 days ago

eb052925

metal : per-device tuned (Q, NE) for flash-attn vec (#25750)

forforever73 committed 5 days ago

0f279350

metal : port new kernels into the split sources

forforever73 committed 5 days ago

55224983

ggml-metal: FWHT kernel for metal backend (#25924)

ggerganov committed 5 days ago

db0a8ce8

metal: fuse snake activation (mul, sin, sqr, mul, add) (#25459)

ggerganov committed 5 days ago

b2d79a7e

metal : add Q2_0 support (#25419)

ggerganov committed 5 days ago

0b6cbb57

metal : add CONV_2D_DW (depthwise convolution) support (#21565)

ggerganov committed 5 days ago

7649856e

metal : add set_rows with src0 f16 (#25434)

ggerganov committed 5 days ago

f348d513

metal: add col2im_1d op (f32/f16/bf16) (#25176)

ggerganov committed 5 days ago

d2112aa3

metal : per-op source split + parallel compile (#24021)

forforever73 committed 5 days ago

ff8169ce

ui: Update vulnerable packages + cleanup Storybook config (#26607)

allozaur committed 6 days ago

Verified e031d956

Prefer npm ci over install for security (#26601)

eapache committed 6 days ago

Verified 6ea215d1

server: decode Windows OEM output to UTF-8 in built-in tools (#26597)

ServeurpersoCom committed 6 days ago

Verified 4308a4f0

mtmd: correcting duplicate empty audio chunks for short inputs (#26536)

Abhinaykrishna2 committed 6 days ago

Verified 474c92e7

sampler : remove "full-context windows" from history-based samplers (#26524)

ggerganov committed 6 days ago

Verified a6aa6f54

gguf-split: Add option to delete split parts during merge (#26538)

guiq83 committed 6 days ago

Verified 76c956c1

ui: CWD for agent (#26518)

allozaur committed 6 days ago

Verified 2f56fc34

mtmd: support Qwen3-TTS (note: breaking change to llama-tts binary) (#26254)

ngxson committed 6 days ago

Verified 07132750

models : fix dflash wo_a reshape on load (#26577)

ggerganov committed 6 days ago

Verified 1c3c9674

ci: fix pre-built binaries no longer working on macOS 15 and below (#26375)

nikwen committed 6 days ago

Verified 6b5224cf

speculative : refactor enabled configs common_speculative_init (#26510)

danbev committed 6 days ago

Verified 7bd8282c

Older