ggerganov/llama.cpp

Pull Requests Commits

ci : disable ccache for msvc windows release jobs

ggerganov committed 16 hours ago

Verified b84a4d10

metal : restore im2col implementation for large kernels (#23901)

ggerganov committed 17 hours ago

Verified 2d9b7c8e

test: (test-llama-archs) log the config name first (#23885)

ngxson committed 19 hours ago

Verified e674b127

ci : update ios-xcode release job to macos-26 (#23906)

ggerganov committed 19 hours ago

Verified 4c4e91b7

ggml : add some lsx support (#23798)

MQ-mengqing committed 20 hours ago

Verified d48a56ef

vulkan: add Flash Attention support for BFloat16 KV cache (#23420)

0cc4m committed 21 hours ago

Verified 6e093b80

ci : fix s390x release job (#23898)

ggerganov committed 23 hours ago

Verified 33752857

ci : clear cache instead of "no timestamp" keys + fix macos (#23895)

ggerganov committed 23 hours ago

Verified d4204b03

llama : do not skip iGPU when only RPC devices are present (#23868)

rgerganov committed 1 day ago

Verified 1738129b

server: in SSE mode, send HTTP headers when slot starts (#23884)

ngxson committed 1 day ago

Verified 0821c5fc

ggml-webgpu: Check earlier for WebGPU required features (#23879)

reeselevine committed 1 day ago

Verified 151f3a98

ggml-webgpu: add q4_0/q8_0 SET_ROWS (#23760)

reeselevine committed 1 day ago

Verified b22da258

server-bench : add speed-bench for speculative decoding benchmarking (#23869)

ruixiang63 committed 1 day ago

Verified 689a9a47

app: add llama update self updater (#23865)

ServeurpersoCom committed 1 day ago

Verified 5a46b46a

ui: handle audio/vnd.wave as audio WAV file (#23754)

ValdikSS committed 1 day ago

Verified 22d66b56

vocab : support tokenizer for LFM2.5-8B-A1B (#23826)

tdakhran committed 1 day ago

Verified 2084434e

graph : ensure DS32 kq_mask_lid is F32 (#23864)

CISC committed 1 day ago

Verified 764f1e64

server: remove obsolete scripts (#23870)

ngxson committed 1 day ago

Verified b5f52280

ci : update macos release to use macos-26 runner (#23878)

ggerganov committed 1 day ago

Verified dc71236b

download: add option to skip_download (#23059)

ngxson committed 1 day ago

Verified 06d26dfd

mtmd: Add DeepSeekOCR 2 Support (#20975)

sfallah committed 1 day ago

Verified da3f990a

CUDA: Check PTX version on host side to guard PDL dispatch (#23530)

ORippler committed 1 day ago

Verified 6ed481ee

server: bump timeout to 3600s (#23842)

ngxson committed 1 day ago

Verified cb47092b

model : support for DeepseekV32ForCausalLM with generic DeepSeek Sparse Attention (DSA) implementation (#23346)

fairydreaming committed 1 day ago

Verified 1f0aa2a6

llama: use f16 mask for FA to save VRAM (#23764)

am17an committed 1 day ago

Verified 031ddb2e

ggerganov committed 1 day ago

fe12e422

ggml : bump version to 0.13.1 (ggml/1523)

ggerganov committed 1 day ago

ea02bc37

ngram-mod : Add missing include (#23857)

oazizi000 committed 1 day ago

Verified b000431a

llama: add llm_graph_input_mtp (#23643)

am17an committed 1 day ago

Verified eef59a76

app : move licences to llama-app (#23824)

angt committed 2 days ago

Verified 98e480a3

Older