ngxson/llama.cpp

Pull Requests Commits

mtmd: correct mtmd_decode_use_mrope()

ngxson committed 72 days ago

00468867

ggml-cuda: flush legacy pool on OOM and retry (#22155)

leonardHONG committed 72 days ago

Verified 97895129

mtmd: correct get_n_pos / get_decoder_pos (#22175)

ngxson committed 72 days ago

Verified 86f8daac

server : remove /api endpoints (#22165)

ggerganov committed 72 days ago

Verified cf8b0dbd

Tensor-parallel: Fix delayed AllReduce on Gemma-4 MoE (#22129)

gaugarg-nv committed 72 days ago

Verified fd6ae4ca

TP: fix 0-sized tensor slices, AllReduce fallback (#21808)

JohannesGaessler committed 72 days ago

Verified fb19f94c

ggml-cpu: Optimized x86 and generic cpu q1_0 dot (follow up) (#21636)

pl752 committed 72 days ago

Verified 7f251fdb

ggml-webgpu: updated matrix-vector multiplication (#21738)

neha-ha committed 72 days ago

Verified a6cc43c2

mtmd: refactor mtmd_decode_use_mrope (#22161)

ngxson committed 72 days ago

Verified a6789166

fix: GLM-DSA crash in llama-tokenize when using vocab_only (#22102)

ssam18 committed 73 days ago

Verified 81df3f7c

server : refactor "use checkpoint" logic (#22114)

ggerganov committed 73 days ago

Verified de71b5f8

[SYCL] Fix reorder MMVQ assert on unaligned vocab sizes (#22035)

PMZFX committed 73 days ago

Verified 788fcbc5

server: rename --clear-idle to --cache-idle-slots (#21741)

yychyo committed 73 days ago

Verified 9d49acb2

vendor : update cpp-httplib to 0.42.0 (#21781)

cabelo committed 73 days ago

Verified e365e658

CUDA: refactor mma data loading for AMD (#22051)

JohannesGaessler committed 73 days ago

Verified 4eac5b45

common/autoparser : allow space after tool call (#22073)

aldehir committed 73 days ago

Verified d5b780a6

HIP: Remove unesscary NCCL_CHECK (#21914)

IMbackK committed 73 days ago

Verified 471540ae

mtmd: add pos_0 to mtmd_image_tokens_get_decoder_pos (breaking change) (#22082)

ngxson committed 73 days ago

Verified 19124078

ggml : reduce CPU overhead in meta backend (#22041)

gaugarg-nv committed 73 days ago

Verified bcdcc104

ci : install spirv-headers for vulkan-cross (#22109)

CISC committed 74 days ago

Verified 037bfe38

convert : support sentence-transformer 5.4 config files (#22087)

Bing-su committed 74 days ago

Verified 8685e7b0

cmake: remove CMP0194 policy to restore MSVC builds (#21934)

texasich committed 74 days ago

Verified 09b4efa9

server : speculative checkpointing (#19493)

srogmann committed 74 days ago

Verified 455d8e4b

rpc : refactor the RPC transport (#21998)

rgerganov committed 74 days ago

Verified 91fef953

server: Expose `media_tag` on /props endpoint. (#22028)

cetarthoriphros committed 74 days ago

Verified 9e5647af

model : refactor bias tensor variable names (#22079)

CISC committed 74 days ago

Verified 4f02d473

android : libcommon -> libllama-common (#22076)

CISC committed 74 days ago

Verified 23b8cc49

ggml-backend-meta: add multi-segment read support in get_tensor (#22063)

ssam18 committed 74 days ago

Verified 59accc88

ci : free disk space for rocm release (#22012)

CISC committed 75 days ago

Verified 83d58e02

convert : fix (ignore for now) typings errors (#22002)

CISC committed 75 days ago

Verified 89a5474f

Older