ngxson/llama.cpp

Pull Requests Commits
server: (router) disable SSL on child process (#18141)
ngxson committed 11 days ago
Verified e85e9d76
llama-fit-params: fix memory print (#18136)
JohannesGaessler committed 11 days ago
Verified 8dcc3662
webui: fix chat header width when sidebar is closed (#17981)
polydecay committed 11 days ago
Verified d37fc935
ggml-hexagon: gelu operation (#17921)
joeldushouyu committed 11 days ago
Verified 4470a076
common : restore grammar-based rejection sampling (#18137)
ggerganov committed 11 days ago
Verified 4301e273
common: clarify instructions for bug reports (#18134)
JohannesGaessler committed 11 days ago
Verified a2c199e4
model: fix GLM-ASR-Nano-2512 load error (#18130) (#18142)
HonestQiao committed 11 days ago
Verified 15dd67d8
server: (router) allow child process to report status via stdout (#18110)
ngxson committed 11 days ago
Verified bde461de
Extend run-org-model.py, add (a) batching (b) loading prompt from file (c) multimodal capacity (#18034)
pwilkin committed 11 days ago
Verified 8faa87db
Github: ask for -v logs for params_fit [no ci] (#18128)
JohannesGaessler committed 11 days ago
Verified 6f1f6a96
ggml-cpu: ARM64: repack version of q8_0 (dotprod and i8mm) (#18096)
Alcpz committed 11 days ago
Verified 669696e0
model: fix LFM2_MOE missing tensors (#18132)
tdakhran committed 11 days ago
Verified 982060fa
ci : clean up webui jobs (#18116)
CISC committed 11 days ago
Verified 6853bee6
common: fix --override-kv to support comma-separated values (#18056)
ServeurpersoCom committed 11 days ago
Verified 487674fb
HIP: Refactor mma for RDNA and CDNA (#17990)
zhang-hui-yulo committed 11 days ago
Verified acec774e
llama.android : Rewrite Android binding (w/o cpu_features dep) (#17413)
naco-siren committed 11 days ago
Verified 5c0d1888
arg: allow -kvu flag for llama-perplexity (#18117)
TrevorS committed 11 days ago
Verified 4b2a4778
ggml : use WARP_SIZE/2 for argmax reduction offset (#18092)
Aadeshveer committed 12 days ago
Verified 58062860
gguf-py : allow converting multi-tensor models from read-only locations (#18100)
ykhrustalev committed 12 days ago
Verified 2973a65e
llama-fit-params: force disable mlock (#18103)
JohannesGaessler committed 12 days ago
Verified d0794e89
llama-fit-params: lower ctx size for multi GPU (#18101)
JohannesGaessler committed 12 days ago
Verified 9dcac6cf
llama-fit-params: fix underflow for dense models (#18095)
JohannesGaessler committed 12 days ago
Verified 0e49a7b8
llama-fit-params: QoL impr. for prints/errors (#18089)
JohannesGaessler committed 12 days ago
Verified 4164596c
model: fix LFM2 missing tensors (#18105)
ngxson committed 12 days ago
Verified ef83fb86
llama: fix early stop in params_fit if ctx is set (#18070)
JohannesGaessler committed 12 days ago
Verified ec98e200
server: fix crash when batch > ubatch with embeddings (#17912)
yifant-code committed 12 days ago
Verified 59977eba
model-conversion : remove -fa option in model card template [no ci] (#18088)
danbev committed 12 days ago
Verified 79dbae03
arch: refactor LLM_TENSOR_NAMES (#18051)
ngxson committed 12 days ago
Verified 7f2b2f3c
arg: clarify auto kvu/np being set on server (#17997)
ngxson committed 12 days ago
Verified 7b1db3d3
Optimization: Qwen3 next autoregressive pass (#17996)
pwilkin committed 12 days ago
Verified a5251ca1
Terms Of Use Privacy Policy Refund Policy Impressum