ggml-org/llama.cpp

Pull Requests Commits

cuda: respect src1 GGML_PREC_F32 in F32/F16 mul_mat

ServeurpersoCom committed 46 minutes ago

f3115198

metal: respect src1 GGML_PREC_F32 in F32/F16 mul_mm

ngxson committed 13 hours ago

62747eb2

docker: add explicit /usr/local/nvidia search path (#31806)

ngxson committed 14 hours ago

Verified 954de248

cli : fix crash on invalid UTF-8 in prompt or files (#31563)

SofianElmotiem committed 19 hours ago

Verified 6c01da62

tests : qualify isnan and signbit with std:: (#31791)

ggerganov committed 19 hours ago

Verified 8820b088

tests : override hardware_concurrency in CI (#31797)

ggerganov committed 19 hours ago

Verified 9a1d03c7

cmake : generate RC file directly without win-app.rc.in (#31718)

angt committed 21 hours ago

Verified 18ab62a8

opencl: support repeat for f16, i32, i16, bf16 (#31782)

lhez committed 22 hours ago

Verified 52c9bad9

webgpu: add batched tensor API (`get_tensor_n` and `set_tensor_n`) (#31473)

yomaytk committed 22 hours ago

Verified 5d3ed2ae

vulkan: detect ReBAR support, avoid BAR allocations if unavailable (#31658)

0cc4m committed 22 hours ago

Verified 80088fa6

moe-cache : LRFU/MQ-like hybrid cache, ClassLRU (#31233)

sanmai committed 22 hours ago

Verified c4fb5796

ci : bump CUDA 13 release builds to 13.5 (#31788)

sam-india-007 committed 23 hours ago

Verified 3ed7284f

vendor: update BoringSSL to 0.20261105.0 (#31757)

cabelo committed 23 hours ago

Verified d9cf1870

CUDA: fix Maxwell build (#31787)

JohannesGaessler committed 23 hours ago

Verified 240d68fc

common : restrict HF token to huggingface.co hosts (#31730)

angt committed 1 day ago

Verified bbc2e4b6

opencl: add q6_k multi column tiled GEMV for speculative verification and refactoring (#31758)

shawngu-quic committed 1 day ago

Verified 4b77dee0

hexagon: Implement set_tensor_n and improve repacking/tiling robustness (#31744)

max-krasnyansky committed 1 day ago

Verified 67107ac3

mtmd: enable cmake unity build (#31760)

ngxson committed 1 day ago

Verified e14a7797

tests : drop u8path() (#31755)

CISC committed 1 day ago

Verified d38bea34

ci: fix build-cmake-pkg ccache (#31705)

netrunnereve committed 1 day ago

Verified 186eab1c

llama: fix kv shifting, add tests, add per-model build_rope (#31683)

ngxson committed 1 day ago

Verified 6023692b

llama, mtmd: (chatterbox) add use_classifier_free_guidance as gguf metadata (#31698)

ngxson committed 1 day ago

Verified b1c902f0

models : recursive fix (#31749)

CISC committed 1 day ago

Verified e8df20d2

model : add Ripple (ricursiveai) (#31692)

notforu777 committed 1 day ago

Verified fecdc81e

model: Add support for the xing4_0 (#31589)

shuxiaoqiong committed 1 day ago

Verified 45b6604b

ui: prevent a hidden sidebar from intercepting clicks (#31712)

ntowle committed 1 day ago

Verified e30ad80f

llama: refactoring: move model to class member of llm_graph_context (#31733)

ngxson committed 1 day ago

Verified e0f96a1a

server : simplify windows MCP command resolution (#31728)

angt committed 1 day ago

Verified 468fde90

vendor : update cpp-httplib to 0.65.0 (#31731)

angt committed 1 day ago

Verified 1416f76a

ggml-cuda: sanitize post-bias NaNs in MoE selection (#31005)

ArberSephirotheca committed 1 day ago

Verified 10d4846a

Older