ggml-org/llama.cpp

Pull Requests Commits
SYCL: Add non contiguous support in RMS_NORM and NORM kernels (#13611)
qnixsynapse committed 210 days ago
Verified 6f180b91
server: fix streaming crashes (#13786)
ochafik committed 210 days ago
Verified 03f582ae
examples/training: Fix file name in README (#13803)
standby24x7 committed 210 days ago
Verified 88c125f2
`server`: fix format of streamed tool call deltas (diff name, fix id location) (#13800)
ochafik committed 210 days ago
Verified d74e94c1
server: fix regression on streamed non-chat completion w/ stops (#13785)
ochafik committed 210 days ago
Verified f13847cf
examples : allow extracting embeddings from decoder contexts (#13797)
ggerganov committed 211 days ago
Verified 79c137f7
llama : clarify deprecation message (#13794)
ggerganov committed 211 days ago
Verified 22229314
sycl: Add more debug prints (#13640)
Rbiessy committed 211 days ago
Verified 9012eb9b
vulkan: mark IM2COL as supporting non-contig (#13783)
jeffbolznv committed 211 days ago
Verified fef693dc
CANN: Add the basic supports of Flash Attention kernel (#13627)
shibizhao committed 211 days ago
Verified 2d38b6e4
`server`: add `--reasoning-budget 0` to disable thinking (incl. qwen3 w/ enable_thinking:false) (#13771)
ochafik committed 211 days ago
Verified e121edc4
webui : bump max upload file size to 500MB (#13779)
ngxson committed 211 days ago
Verified 2f099b51
tests : improve UGM tokenizer test coverage (#13773)
CISC committed 211 days ago
Verified aa50ba46
kv-cache : rework kv_cell (#13706)
ggerganov committed 211 days ago
Verified de2ef53a
rpc : Fix build on OpenBSD (#13541)
percypiper committed 211 days ago
Verified c508256d
mtmd : add support for Qwen2-Audio and SeaLLM-Audio (#13760)
ngxson committed 211 days ago
Verified 40aaa8a4
docs : add Moondream2 pre-quantized link (#13745)
ddpasa committed 211 days ago
Verified a08c1d28
server: fix/test add_generation_prompt (#13770)
ochafik committed 212 days ago
Verified d785f9c1
llama : add support for Qwen3 MoE tied word embeddings (#13768)
estibi committed 212 days ago
Verified 4032ca40
SYCL: revert "sycl: simplify bin_bcast_kernel (#13383)" (#13752)
qnixsynapse committed 212 days ago
Verified 515fdbf7
`server`: streaming of tool calls and thoughts when `--jinja` is on (#12379)
ochafik committed 212 days ago
Verified f5cd27b7
releases : bundle llvm omp library in windows release (#13763)
slaren committed 212 days ago
Verified a2d02d57
releases : enable openmp in windows cpu backend build (#13756)
slaren committed 212 days ago
Verified 17fc817b
ggml-cpu : set openmp wait time if not set (#13758)
slaren committed 212 days ago
Verified 2bd1b30f
Move GLM4 f32 attention fix to the correct function (#13750)
0cc4m committed 212 days ago
Verified 259469c4
ggml : add ggml_gelu_erf() CUDA kernel (#13719)
ngxson committed 213 days ago
Verified 4c32832c
vocab : fix ugm tokenizer precision (#13743)
CISC committed 213 days ago
Verified c3a26243
CUDA: fix race condition in FA vector kernels (#13742)
JohannesGaessler committed 213 days ago
Verified ffd0eae6
ci : enable winget package updates (#13734)
slaren committed 213 days ago
Verified b775345d
ci : add winget package updater (#13732)
slaren committed 213 days ago
Verified a70a8a69
Terms Of Use Privacy Policy Refund Policy Impressum