ngxson/llama.cpp

Pull Requests Commits

server: (router) disable SSL on child process

ngxson committed 50 days ago

f0e223d9

server: (router) allow child process to report status via stdout (#18110)

ngxson committed 50 days ago

Verified bde461de

Extend run-org-model.py, add (a) batching (b) loading prompt from file (c) multimodal capacity (#18034)

pwilkin committed 50 days ago

Verified 8faa87db

Github: ask for -v logs for params_fit [no ci] (#18128)

JohannesGaessler committed 50 days ago

Verified 6f1f6a96

ggml-cpu: ARM64: repack version of q8_0 (dotprod and i8mm) (#18096)

Alcpz committed 50 days ago

Verified 669696e0

model: fix LFM2_MOE missing tensors (#18132)

tdakhran committed 50 days ago

Verified 982060fa

ci : clean up webui jobs (#18116)

CISC committed 50 days ago

Verified 6853bee6

common: fix --override-kv to support comma-separated values (#18056)

ServeurpersoCom committed 50 days ago

Verified 487674fb

HIP: Refactor mma for RDNA and CDNA (#17990)

zhang-hui-yulo committed 50 days ago

Verified acec774e

llama.android : Rewrite Android binding (w/o cpu_features dep) (#17413)

naco-siren committed 50 days ago

Verified 5c0d1888

arg: allow -kvu flag for llama-perplexity (#18117)

TrevorS committed 50 days ago

Verified 4b2a4778

ggml : use WARP_SIZE/2 for argmax reduction offset (#18092)

Aadeshveer committed 50 days ago

Verified 58062860

gguf-py : allow converting multi-tensor models from read-only locations (#18100)

ykhrustalev committed 50 days ago

Verified 2973a65e

llama-fit-params: force disable mlock (#18103)

JohannesGaessler committed 50 days ago

Verified d0794e89

llama-fit-params: lower ctx size for multi GPU (#18101)

JohannesGaessler committed 50 days ago

Verified 9dcac6cf

llama-fit-params: fix underflow for dense models (#18095)

JohannesGaessler committed 50 days ago

Verified 0e49a7b8

llama-fit-params: QoL impr. for prints/errors (#18089)

JohannesGaessler committed 50 days ago

Verified 4164596c

model: fix LFM2 missing tensors (#18105)

ngxson committed 51 days ago

Verified ef83fb86

llama: fix early stop in params_fit if ctx is set (#18070)

JohannesGaessler committed 51 days ago

Verified ec98e200

server: fix crash when batch > ubatch with embeddings (#17912)

yifant-code committed 51 days ago

Verified 59977eba

model-conversion : remove -fa option in model card template [no ci] (#18088)

danbev committed 51 days ago

Verified 79dbae03

arch: refactor LLM_TENSOR_NAMES (#18051)

ngxson committed 51 days ago

Verified 7f2b2f3c

arg: clarify auto kvu/np being set on server (#17997)

ngxson committed 51 days ago

Verified 7b1db3d3

Optimization: Qwen3 next autoregressive pass (#17996)

pwilkin committed 51 days ago

Verified a5251ca1

CLI: fixed adding cli and completion into docker containers, improved docs (#18003)

andrew-aladev committed 51 days ago

Verified fb644247

server: Update README.md incorrect argument (#18073)

2114L3 committed 51 days ago

Verified 5f5f9b46

model: support GLM4V vision encoder (#18042)

ngxson committed 51 days ago

Verified 3d86c6c2

model-conversion : add note about verifying previous models (#18082)

danbev committed 51 days ago

Verified 9963b81f

model-conversion : use CONVERTED_EMBEDDING_MODEL for embedding_verify_logits (#18079)

danbev committed 51 days ago

Verified db81d5ec

common : add nemotron 3 parsing (#18077)

aldehir committed 51 days ago

Verified c05aa69f

Older