ngxson/llama.cpp

Pull Requests Commits

Update common/chat.cpp

ngxson committed 1 day ago

Verified 2862ba2d

chat: fix language input for translategemma

ngxson committed 2 days ago

3f3a4290

graph : utilize `ggml_build_forward_select()` to avoid reallocations (#18898)

ggerganov committed 2 days ago

Verified 557515be

[SYCL] use malloc to support both iGPU and dGPU in same time (#18992)

arthw committed 2 days ago

Verified cb6caca1

chat : fix translategemma crash on common_chat_format_example (#19019)

ngxson committed 2 days ago

Verified b5b8fa1c

model-conversion : use BUILD_DIR variable in all scripts (#19015)

danbev committed 2 days ago

Verified a14b960b

ggml-cpu: aarm64: q5_K repack gemm and gemv (and generic) implementations (i8mm) (#18860)

Alcpz committed 2 days ago

Verified 091a46cb

cli : load parser definition (#19031)

aldehir committed 3 days ago

Verified a3e81281

server : support preserving reasoning_content in assistant message (#18994)

ngxson committed 3 days ago

Verified 51fa458a

mla : make the V tensor a view of K (#18986)

ggerganov committed 3 days ago

Verified a5eaa1d6

CUDA: fix alignment check for FA (#19023)

JohannesGaessler committed 3 days ago

Verified e2baf021

convert_hf_to_gguf.py: refactor modify_tensors to call super (#18866)

am17an committed 3 days ago

Verified e34d6d03

opencl: enable the general fp mm for non-cont input and as a fallback for specialized kqv kernel for adreno (#18970)

lhez committed 3 days ago

Verified 9c96465f

server: do not log certain endpoints (avoid log spam) (#19028)

ngxson committed 3 days ago

Verified 4e595b25

quant : manual overrides of tensor types take precedence (#18952)

ggerganov committed 3 days ago

Verified 0e4ebeb0

release: update github api (#19022)

taronaeo committed 3 days ago

Verified 8b308407

mtmd : update docs to use llama_model_n_embd_inp (#18999)

ngxson committed 3 days ago

Verified 9eb5bfec

server: Reorder methods in `server-task.cpp` (#19016)

openingnow committed 3 days ago

Verified c6926d1d

CUDA: add gqa_ratio 4 for GLM 4.7 flash (#18953)

am17an committed 3 days ago

Verified b70d2510

opencl: add TRI op support (#18979)

shaofeiqi committed 3 days ago

Verified 5516b9c1

ggml-zdnn : mark zDNN buffers as non-host (#18967)

AlekseiNikiforovIBM committed 4 days ago

Verified 94242a62

ci : update GitHub Actions versions [no ci] (#18935)

pgoslatara committed 4 days ago

Verified 6b99a223

convert : add Devstral-2 (Ministral3ForCausalLM) arch (#18972)

emsi committed 4 days ago

Verified 77078e80

jinja: support none|string (#18995)

pwilkin committed 4 days ago

Verified c301172f

fix: Use `tabular-nums` for chat message statistics (#18915)

nathanlesage committed 4 days ago

Verified 3802d3c7

llama : clarify nemotron-h.cpp comment about RoPE [no ci] (#18997)

danbev committed 4 days ago

Verified 9da3dcd7

vulkan: Remove transfer_ctx, do everything in compute_ctx. (#18945)

jeffbolznv committed 4 days ago

Verified bd544c94

common : improve error message when HTTPS is missing but required (#18987)

angt committed 4 days ago

Verified 14be5a39

server: /v1/responses (partial) (#18486)

openingnow committed 4 days ago

Verified fbbf3ad1

vulkan: support flash attention GQA/split_k with small batches (#18938)

jeffbolznv committed 4 days ago

Verified 33f890e5

Older