ngxson/llama.cpp

Pull Requests Commits

ngxson committed 60 days ago

2fb3b2ec

server: (router) expose child model info from router's /v1/models

ngxson committed 60 days ago

60f43d21

CUDA: use fastdiv for batch index split in get_rows (#22650)

leonardHONG committed 60 days ago

Verified e77056f9

server: implement /models?reload=1 (#21848)

ngxson committed 60 days ago

Verified 935a3402

examples: refactor diffusion generation (#22590)

Sailaukan committed 60 days ago

Verified d8794eec

webui : fix circular dependency between chat.service.ts and models.svelte.ts (#22625)

Juste-Leo2 committed 60 days ago

Verified 36a694c9

common/autoparser: fixes for newline handling / forced tool calls (#22654)

pwilkin committed 60 days ago

Verified a4701c98

model: move `load_hparams` and `load_tensors` to per-model definition (#22004)

ngxson committed 60 days ago

Verified 994118a1

server: Add a simple get_datetime server tool (#22649)

eapache committed 60 days ago

Verified c84e6d6d

webui: restore missing settings (#22666)

ntowle committed 60 days ago

Verified fa8feaed

docs : update speculative decoding parameters after refactor (#22397) (#22539)

ggerganov committed 60 days ago

Verified 846262d7

vulkan: delete dead GGML_VK_MAX_NODES def (#22621)

Atomic-Germ committed 60 days ago

Verified 6dcd824f

ggml-webgpu: add layer norm ops (#22406)

Constannnnnt committed 60 days ago

Verified d4b0c22f

common : determine generation prompt using longest common prefix (#22657)

aldehir committed 61 days ago

Verified e48034df

convert : Mistral format yarn apply_scale support (#22612)

juliendenize committed 61 days ago

Verified 048a490f

convert : apply Q/K RoPE permutation in NVFP4 repack path (#22611)

jmrobles committed 61 days ago

Verified db44417b

fix: CUDA device PCI bus ID de-dupe OOMing (ignoring other 3 gpus entirely) (#22533)

lucyknada committed 62 days ago

Verified d05fe1d7

server : avoid checkpoint data host copies (#22558)

ggerganov committed 62 days ago

Verified 0754b7b6

ggml-virtgpu: fix circular dependency in headers (#22557)

Juste-Leo2 committed 62 days ago

Verified 09294365

convert : disable uint types (#18908)

csabakecskemeti committed 62 days ago

Verified 63d93d17

opencl: Adreno optimization for MoE - MxFP4 (#22301)

shawngu-quic committed 62 days ago

Verified c5a3bc39

Github: update issue templates (#22594)

JohannesGaessler committed 62 days ago

Verified 9dbb3726

ggerganov committed 62 days ago

228e8363

ggml : bump version to 0.10.2 (ggml/1474)

ggerganov committed 62 days ago

ed23489f

ggerganov committed 62 days ago

457e2288

ggml : try fix win32 build (whisper/0)

ggerganov committed 62 days ago

e8ec7ab0

hexagon: hmx flash attention (#22347)

njsyw1997 committed 62 days ago

Verified 1a03cf47

llama-quant : fix `--tensor-type` when default `qtype` is overriden (#22572)

ddh0 committed 63 days ago

Verified b97ebdc9

hexagon: enable non-contiguous row tensor support for unary ops (#22574)

aparmp-quic committed 63 days ago

Verified 2098fd61

webui: Spring Cleaning Refactor v1 (#22505)

allozaur committed 63 days ago

Verified ab6120cd

Older