ngxson/llama.cpp

Pull Requests Commits

backend test works but real model breaks

ngxson committed 94 days ago

cada3766

poc: add ANE backend

ngxson committed 94 days ago

ac0a0f27

ui: exclude generated build dirs from prettier and eslint so lint errors stop being masked (#23910)

ServeurpersoCom committed 95 days ago

Verified d38d50e7

TP: fix granularity for Qwen 3.5/3.6 + 3 GPUs (#23843)

JohannesGaessler committed 95 days ago

Verified 8b0e0db6

metal : restore im2col implementation for large kernels (#23901)

ggerganov committed 95 days ago

Verified 2d9b7c8e

test: (test-llama-archs) log the config name first (#23885)

ngxson committed 95 days ago

Verified e674b127

ci : update ios-xcode release job to macos-26 (#23906)

ggerganov committed 95 days ago

Verified 4c4e91b7

ggml : add some lsx support (#23798)

MQ-mengqing committed 95 days ago

Verified d48a56ef

vulkan: add Flash Attention support for BFloat16 KV cache (#23420)

0cc4m committed 95 days ago

Verified 6e093b80

ci : fix s390x release job (#23898)

ggerganov committed 95 days ago

Verified 33752857

ci : clear cache instead of "no timestamp" keys + fix macos (#23895)

ggerganov committed 95 days ago

Verified d4204b03

llama : do not skip iGPU when only RPC devices are present (#23868)

rgerganov committed 95 days ago

Verified 1738129b

server: in SSE mode, send HTTP headers when slot starts (#23884)

ngxson committed 95 days ago

Verified 0821c5fc

ggml-webgpu: Check earlier for WebGPU required features (#23879)

reeselevine committed 95 days ago

Verified 151f3a98

ggml-webgpu: add q4_0/q8_0 SET_ROWS (#23760)

reeselevine committed 95 days ago

Verified b22da258

server-bench : add speed-bench for speculative decoding benchmarking (#23869)

ruixiang63 committed 95 days ago

Verified 689a9a47

app: add llama update self updater (#23865)

ServeurpersoCom committed 95 days ago

Verified 5a46b46a

ui: handle audio/vnd.wave as audio WAV file (#23754)

ValdikSS committed 95 days ago

Verified 22d66b56

vocab : support tokenizer for LFM2.5-8B-A1B (#23826)

tdakhran committed 95 days ago

Verified 2084434e

graph : ensure DS32 kq_mask_lid is F32 (#23864)

CISC committed 95 days ago

Verified 764f1e64

server: remove obsolete scripts (#23870)

ngxson committed 96 days ago

Verified b5f52280

ci : update macos release to use macos-26 runner (#23878)

ggerganov committed 96 days ago

Verified dc71236b

download: add option to skip_download (#23059)

ngxson committed 96 days ago

Verified 06d26dfd

mtmd: Add DeepSeekOCR 2 Support (#20975)

sfallah committed 96 days ago

Verified da3f990a

CUDA: Check PTX version on host side to guard PDL dispatch (#23530)

ORippler committed 96 days ago

Verified 6ed481ee

server: bump timeout to 3600s (#23842)

ngxson committed 96 days ago

Verified cb47092b

model : support for DeepseekV32ForCausalLM with generic DeepSeek Sparse Attention (DSA) implementation (#23346)

fairydreaming committed 96 days ago

Verified 1f0aa2a6

llama: use f16 mask for FA to save VRAM (#23764)

am17an committed 96 days ago

Verified 031ddb2e

ggerganov committed 96 days ago

fe12e422

ggml : bump version to 0.13.1 (ggml/1523)

ggerganov committed 96 days ago

ea02bc37

Older