ngxson/llama.cpp

Pull Requests Commits

make sure router gate is always F32

ngxson committed 100 days ago

b29c49fc

also handle MTP tensors

ngxson committed 100 days ago

21f1d763

ngxson committed 102 days ago

081d7145

clean up comments

ngxson committed 102 days ago

be460f26

ngxson committed 102 days ago

e98e88ea

ngxson committed 102 days ago

c95efc22

mtmd: Unlimited-OCR fix max_tiles, setting in converter (#25614)

sfallah committed 102 days ago

Verified b06aa774

grammar : degrade max repetition >= 2000 to unbounded (#26613)

aldehir committed 102 days ago

Verified cd0fa605

mtmd: support multi-row batching for deepseek-ocr (#26154)

ngxson committed 102 days ago

Verified 717dad5c

fit: Fix memory allocation for MTP layers (#26605)

smalinin committed 102 days ago

Verified 9a688e51

security : clarify about AI-generated reports (#26579)

ngxson committed 102 days ago

Verified 9303cdd8

server: Adding spec-decode counters to /metrics endpoint (#26389)

BLSharda committed 102 days ago

Verified a035a888

convert: Add endianness conversion for Q1 and TQ2 quantizations (#26618)

Andreas-Krebbel committed 102 days ago

Verified 020760ad

vendor : apply patches for subprocess.h (#26606)

ngxson committed 102 days ago

Verified 61881b1f

ui: show generation statistics by default in chat settings (#26624)

allozaur committed 102 days ago

Verified 3e3a7a41

build : remove GGML_METAL_USE_BF16 from all build scripts (#26604)

nikwen committed 102 days ago

Verified d52ec04a

ui: Update vulnerable packages + cleanup Storybook config (#26607)

allozaur committed 102 days ago

Verified e031d956

Prefer npm ci over install for security (#26601)

eapache committed 103 days ago

Verified 6ea215d1

server: decode Windows OEM output to UTF-8 in built-in tools (#26597)

ServeurpersoCom committed 103 days ago

Verified 4308a4f0

mtmd: correcting duplicate empty audio chunks for short inputs (#26536)

Abhinaykrishna2 committed 103 days ago

Verified 474c92e7

sampler : remove "full-context windows" from history-based samplers (#26524)

ggerganov committed 103 days ago

Verified a6aa6f54

gguf-split: Add option to delete split parts during merge (#26538)

guiq83 committed 103 days ago

Verified 76c956c1

ui: CWD for agent (#26518)

allozaur committed 103 days ago

Verified 2f56fc34

mtmd: support Qwen3-TTS (note: breaking change to llama-tts binary) (#26254)

ngxson committed 103 days ago

Verified 07132750

models : fix dflash wo_a reshape on load (#26577)

ggerganov committed 103 days ago

Verified 1c3c9674

ci: fix pre-built binaries no longer working on macOS 15 and below (#26375)

nikwen committed 103 days ago

Verified 6b5224cf

speculative : refactor enabled configs common_speculative_init (#26510)

danbev committed 103 days ago

Verified 7bd8282c

gguf-py: validate n_dims and guard against uint64 overflow in reader (#25401)

hclsys committed 103 days ago

Verified 5788b510

ggerganov committed 103 days ago

2e17f69e

ggml : bump version to 0.18.1 (ggml/1578)

ggerganov committed 103 days ago

15831f57

Older