ggml-org/llama.cpp

Pull Requests Commits

prof: fix tensor dims formatter

max-krasnyansky committed 27 days ago

6b1394ed

profiler: output all tensor names

max-krasnyansky committed 27 days ago

26ec4096

profiler: initial support for profiling graph ops

max-krasnyansky committed 27 days ago

6a5af059

ggml-hexagon: swiglu_oai operation (#18114)

joeldushouyu committed 28 days ago

Verified 0a0bba05

convert : force patch_merger tensors to f16/f32 (#18124)

CISC committed 28 days ago

Verified 5166aaf8

server: (webui) add --webui-config (#18028)

ServeurpersoCom committed 28 days ago

Verified 6ce3d857

server: (router) disable SSL on child process (#18141)

ngxson committed 28 days ago

Verified e85e9d76

llama-fit-params: fix memory print (#18136)

JohannesGaessler committed 28 days ago

Verified 8dcc3662

webui: fix chat header width when sidebar is closed (#17981)

polydecay committed 28 days ago

Verified d37fc935

ggml-hexagon: gelu operation (#17921)

joeldushouyu committed 28 days ago

Verified 4470a076

common : restore grammar-based rejection sampling (#18137)

ggerganov committed 28 days ago

Verified 4301e273

common: clarify instructions for bug reports (#18134)

JohannesGaessler committed 28 days ago

Verified a2c199e4

model: fix GLM-ASR-Nano-2512 load error (#18130) (#18142)

HonestQiao committed 28 days ago

Verified 15dd67d8

server: (router) allow child process to report status via stdout (#18110)

ngxson committed 28 days ago

Verified bde461de

Extend run-org-model.py, add (a) batching (b) loading prompt from file (c) multimodal capacity (#18034)

pwilkin committed 28 days ago

Verified 8faa87db

Github: ask for -v logs for params_fit [no ci] (#18128)

JohannesGaessler committed 28 days ago

Verified 6f1f6a96

ggml-cpu: ARM64: repack version of q8_0 (dotprod and i8mm) (#18096)

Alcpz committed 28 days ago

Verified 669696e0

model: fix LFM2_MOE missing tensors (#18132)

tdakhran committed 28 days ago

Verified 982060fa

ci : clean up webui jobs (#18116)

CISC committed 28 days ago

Verified 6853bee6

common: fix --override-kv to support comma-separated values (#18056)

ServeurpersoCom committed 28 days ago

Verified 487674fb

HIP: Refactor mma for RDNA and CDNA (#17990)

zhang-hui-yulo committed 28 days ago

Verified acec774e

llama.android : Rewrite Android binding (w/o cpu_features dep) (#17413)

naco-siren committed 28 days ago

Verified 5c0d1888

arg: allow -kvu flag for llama-perplexity (#18117)

TrevorS committed 28 days ago

Verified 4b2a4778

ggml : use WARP_SIZE/2 for argmax reduction offset (#18092)

Aadeshveer committed 28 days ago

Verified 58062860

gguf-py : allow converting multi-tensor models from read-only locations (#18100)

ykhrustalev committed 28 days ago

Verified 2973a65e

llama-fit-params: force disable mlock (#18103)

JohannesGaessler committed 28 days ago

Verified d0794e89

llama-fit-params: lower ctx size for multi GPU (#18101)

JohannesGaessler committed 28 days ago

Verified 9dcac6cf

llama-fit-params: fix underflow for dense models (#18095)

JohannesGaessler committed 28 days ago

Verified 0e49a7b8

llama-fit-params: QoL impr. for prints/errors (#18089)

JohannesGaessler committed 29 days ago

Verified 4164596c

model: fix LFM2 missing tensors (#18105)

ngxson committed 29 days ago

Verified ef83fb86

Older