ggerganov/llama.cpp

Pull Requests Commits

pi : add rule to use gh CLI for GitHub resources

ggerganov committed 10 days ago

Verified 6eddb1c6

docs : update speculative decoding parameters after refactor (#22397)

ggerganov committed 10 days ago

Verified c6dbd311

scripts : add wc2wt.sh - create worktree from current HEAD (#22513)

ggerganov committed 10 days ago

Verified 27aef3dd

add fast matmul iquants (#22504)

SharmaRithik committed 10 days ago

Verified 45155597

spec : fix draft model checkpoints (#22521)

ggerganov committed 10 days ago

Verified 80afa33a

spec : fix vocab compat checks in spec example (#22426)

petersid2022 committed 10 days ago

Verified b42c7fa5

common : do not pass prompt tokens to reasoning budget sampler (#22488)

aldehir committed 11 days ago

Verified d7759923

hexagon: make vmem and buffer-size configurable (#22487)

max-krasnyansky committed 11 days ago

Verified 41a63be2

CUDA: fuse SSM_CONV + ADD(bias) + SILU (#22478)

anavp-nvidia committed 11 days ago

Verified 098705a2

spec : disacard last drafted token with low prob (#22506)

ggerganov committed 11 days ago

Verified 683c5acb

ggerganov committed 11 days ago

b1d5f5b4

ggml : bump version to 0.10.1 (ggml/1469)

ggerganov committed 11 days ago

4b221b7f

webui: fix slow mic stop and WAV encode (#22480)

ServeurpersoCom committed 11 days ago

Verified 59237bfb

ggml-cpu : disable tiled matmul on AIX to fix page boundary segfault (#22293)

shalinib-ibm committed 11 days ago

Verified 1cbc846e

ggml-cuda: refactor fusion code (#22468)

am17an committed 11 days ago

Verified 3142f1db

ggml-cpu: cmake: append xsmtvdotii march for SpacemiT IME (#22317)

qiurui144 committed 11 days ago

Verified b5c4227d

ggml-webgpu: Fix bug in FlashAttention support check (#22492)

reeselevine committed 11 days ago

Verified d6a50940

common: Intentionally leak logger instance to fix hanging on Windows (#22273)

rillomas committed 11 days ago

Verified 7b95ea5d

ggml : add sve tuned code for gemm_q8_0_4x8_q8_0() kernel (#21916)

hrushitfujitsu committed 11 days ago

Verified bdc9c743

TP: fix delayed AllReduce + zero-sized slices (#22489)

JohannesGaessler committed 11 days ago

Verified 739393be

ggml-cuda: Repost of 21896: Blackwell native NVFP4 support (#22196)

michaelw9999 committed 11 days ago

Verified fc2b0053

ggml-cuda: add flash-attn support for DKQ=320/DV=256 with ncols2=32 (… (#22286)

lnigam committed 12 days ago

Verified 7b8443ac

convert : add support for Nemotron Nano 3 Omni (#22481)

danbev committed 12 days ago

Verified 5d56effd

common : re-arm reasoning budget after DONE on new <think> (#22323)

BruceJillis committed 12 days ago

Verified 52e5f0a5

vulkan: Coalesce Q4_K/Q5_K scale loads (#21751)

TheBlueMatt committed 12 days ago

Verified f9f33654

ggml-webgpu: fix buffer aliasing for ssm_scan and refactor aliasing logic (#22456)

reeselevine committed 12 days ago

Verified 98bb5791

webui: Server tools (#21237)

allozaur committed 12 days ago

Verified f42e29fd

vulkan: add barrier after writetimestamp (#21865)

jeffbolznv committed 12 days ago

Verified 19821178

ggml: improve SPIR-V headers detection with __has_include (#21918)

EmilAskerov committed 12 days ago

Verified 698d19b9

ggml : skip already registered backends and devices (#22296)

angt committed 12 days ago

Verified 50494a28

Older