ggerganov/llama.cpp

Pull Requests Commits

ggerganov committed 13 days ago

Verified f8463295

Merge branch 'master' into pr/18039

ggerganov committed 13 days ago

Verified 4567954a

server : validate --tools CLI argument against known tool names (#22538)

ggerganov committed 14 days ago

Verified 2bacb1eb

llama : add option to save memory in device buffers (#22679)

ggerganov committed 14 days ago

Verified d6e7b033

graph : handle non-contiguous Q/K/V in mul_mat_aux (#22630)

CISC committed 14 days ago

Verified fa595462

ggml : implement fast walsh-hadamard transform for kv rotation (#21352) (#22631)

AlrIsmail committed 14 days ago

Verified a817a22b

kleidiai : update to v1.24.0 and use release archive (#22549)

chaxu01 committed 14 days ago

Verified eff06702

Merge branch 'master' into pr/18039

ggerganov committed 14 days ago

Verified 069be0ae

CUDA: use fastdiv for batch index split in get_rows (#22650)

leonardHONG committed 14 days ago

Verified e77056f9

server: implement /models?reload=1 (#21848)

ngxson committed 14 days ago

Verified 935a3402

examples: refactor diffusion generation (#22590)

Sailaukan committed 14 days ago

Verified d8794eec

webui : fix circular dependency between chat.service.ts and models.svelte.ts (#22625)

Juste-Leo2 committed 14 days ago

Verified 36a694c9

common/autoparser: fixes for newline handling / forced tool calls (#22654)

pwilkin committed 14 days ago

Verified a4701c98

model: move `load_hparams` and `load_tensors` to per-model definition (#22004)

ngxson committed 14 days ago

Verified 994118a1

server: Add a simple get_datetime server tool (#22649)

eapache committed 14 days ago

Verified c84e6d6d

webui: restore missing settings (#22666)

ntowle committed 14 days ago

Verified fa8feaed

docs : update speculative decoding parameters after refactor (#22397) (#22539)

ggerganov committed 14 days ago

Verified 846262d7

vulkan: delete dead GGML_VK_MAX_NODES def (#22621)

Atomic-Germ committed 14 days ago

Verified 6dcd824f

ggml-webgpu: add layer norm ops (#22406)

Constannnnnt committed 15 days ago

Verified d4b0c22f

common : determine generation prompt using longest common prefix (#22657)

aldehir committed 15 days ago

Verified e48034df

convert : Mistral format yarn apply_scale support (#22612)

juliendenize committed 15 days ago

Verified 048a490f

convert : apply Q/K RoPE permutation in NVFP4 repack path (#22611)

jmrobles committed 15 days ago

Verified db44417b

fix: CUDA device PCI bus ID de-dupe OOMing (ignoring other 3 gpus entirely) (#22533)

lucyknada committed 16 days ago

Verified d05fe1d7

Merge branch 'master' into pr/18039

ggerganov committed 16 days ago

Verified 459b02f6

server : avoid checkpoint data host copies (#22558)

ggerganov committed 16 days ago

Verified 0754b7b6

ggml-virtgpu: fix circular dependency in headers (#22557)

Juste-Leo2 committed 16 days ago

Verified 09294365

convert : disable uint types (#18908)

csabakecskemeti committed 16 days ago

Verified 63d93d17

opencl: Adreno optimization for MoE - MxFP4 (#22301)

shawngu-quic committed 16 days ago

Verified c5a3bc39

Github: update issue templates (#22594)

JohannesGaessler committed 16 days ago

Verified 9dbb3726

ggerganov committed 16 days ago

228e8363

Older