ggerganov/llama.cpp

Pull Requests Commits

ggerganov committed 16 days ago

Verified 9d588703

server : avoid checkpoint data host copies

ggerganov committed 16 days ago

Verified a7c1110e

ci : bump ty to 0.0.33 (#22535)

CISC committed 16 days ago

Verified 6118c043

vendor : update cpp-httplib to 0.43.2 (#22548)

angt committed 16 days ago

Verified 5f0ab726

CUDA: fix tile FA kernel on Pascal (#22541)

JohannesGaessler committed 16 days ago

Verified e82aaf25

scripts : add wc2wt.sh - create worktree from current HEAD (#22513)

ggerganov committed 16 days ago

Verified 27aef3dd

add fast matmul iquants (#22504)

SharmaRithik committed 16 days ago

Verified 45155597

spec : fix draft model checkpoints (#22521)

ggerganov committed 16 days ago

Verified 80afa33a

spec : fix vocab compat checks in spec example (#22426)

petersid2022 committed 16 days ago

Verified b42c7fa5

common : do not pass prompt tokens to reasoning budget sampler (#22488)

aldehir committed 16 days ago

Verified d7759923

hexagon: make vmem and buffer-size configurable (#22487)

max-krasnyansky committed 16 days ago

Verified 41a63be2

CUDA: fuse SSM_CONV + ADD(bias) + SILU (#22478)

anavp-nvidia committed 16 days ago

Verified 098705a2

spec : disacard last drafted token with low prob (#22506)

ggerganov committed 17 days ago

Verified 683c5acb

ggerganov committed 17 days ago

b1d5f5b4

ggml : bump version to 0.10.1 (ggml/1469)

ggerganov committed 17 days ago

4b221b7f

webui: fix slow mic stop and WAV encode (#22480)

ServeurpersoCom committed 17 days ago

Verified 59237bfb

ggml-cpu : disable tiled matmul on AIX to fix page boundary segfault (#22293)

shalinib-ibm committed 17 days ago

Verified 1cbc846e

ggml-cuda: refactor fusion code (#22468)

am17an committed 17 days ago

Verified 3142f1db

ggml-cpu: cmake: append xsmtvdotii march for SpacemiT IME (#22317)

qiurui144 committed 17 days ago

Verified b5c4227d

ggml-webgpu: Fix bug in FlashAttention support check (#22492)

reeselevine committed 17 days ago

Verified d6a50940

common: Intentionally leak logger instance to fix hanging on Windows (#22273)

rillomas committed 17 days ago

Verified 7b95ea5d

ggml : add sve tuned code for gemm_q8_0_4x8_q8_0() kernel (#21916)

hrushitfujitsu committed 17 days ago

Verified bdc9c743

TP: fix delayed AllReduce + zero-sized slices (#22489)

JohannesGaessler committed 17 days ago

Verified 739393be

ggml-cuda: Repost of 21896: Blackwell native NVFP4 support (#22196)

michaelw9999 committed 17 days ago

Verified fc2b0053

ggml-cuda: add flash-attn support for DKQ=320/DV=256 with ncols2=32 (… (#22286)

lnigam committed 17 days ago

Verified 7b8443ac

convert : add support for Nemotron Nano 3 Omni (#22481)

danbev committed 18 days ago

Verified 5d56effd

common : re-arm reasoning budget after DONE on new <think> (#22323)

BruceJillis committed 18 days ago

Verified 52e5f0a5

vulkan: Coalesce Q4_K/Q5_K scale loads (#21751)

TheBlueMatt committed 18 days ago

Verified f9f33654

ggml-webgpu: fix buffer aliasing for ssm_scan and refactor aliasing logic (#22456)

reeselevine committed 18 days ago

Verified 98bb5791

webui: Server tools (#21237)

allozaur committed 18 days ago

Verified f42e29fd

Older