ggml-org/llama.cpp

Pull Requests Commits

move copilot instructions to AGENTS.md (#18259)

ngxson committed 10 days ago

Verified 5e25ddeb

vulkan: fix im2col overflowing maxworkgroupcount (#18180)

jeffbolznv committed 11 days ago

Verified fd05c51c

vulkan/cuda: fix topk_moe with exp_probs_b (#18071)

jeffbolznv committed 11 days ago

Verified b365c3ff

vulkan: support GGML_UNARY_OP_XIELU (#18062)

jeffbolznv committed 11 days ago

Verified cb64222b

vulkan: in graph_optimize, try to group ADD operations (#18060)

jeffbolznv committed 11 days ago

Verified 6eb70818

Vulkan: some improvement on mul_mat_iq2_xs (#18031)

lovedheart committed 11 days ago

Verified 4117ae55

docs : fix links in parsing.md (#18245)

danbev committed 11 days ago

Verified 65e96a24

common : reorganize includes to prioritize vendored deps (#18222)

aldehir committed 11 days ago

Verified 9496bbb8

server: add auto-sleep after N seconds of idle (#18228)

ngxson committed 11 days ago

Verified ddcb75dd

tests: Avoid floating point precision false positives in SUM (#17471)

jeffbolznv committed 11 days ago

Verified 52ab19df

test-backend-ops: improve msvc build time (#18209)

jeffbolznv committed 11 days ago

Verified 5182dd64

Added comments explaining thread block size selection logic based on row count and column size, derived from historical commit context (#18212)

Aadeshveer committed 12 days ago

Verified 10b4f82d

server : [easy] fix per round speculative decode logging (#18211)

okuvshynov committed 12 days ago

Verified 408616ad

server: support load model on startup, support preset-only options (#18206)

ngxson committed 12 days ago

Verified 9e39a1e6

ci : remove non-windows zip artifacts (#18201)

CISC committed 12 days ago

Verified 74e05131

ci : only save ccache on master (#18207)

CISC committed 12 days ago

Verified f74747d8

ggml-hexagon: Implement true Q8_0 quantization on Hexagon NPU for more accurate mixed-precision matmul operations (#17977)

ngdxzy committed 12 days ago

Verified ce734a8a

arg: fix order to use short form before long form (#18196)

ServeurpersoCom committed 12 days ago

Verified 14931a82

Build with CCCL 3.2 for CUDA backends

ORippler committed 12 days ago

1da013c6

llama : Changing off_t to size_t for Windows (#18204)

JTischbein committed 12 days ago

Verified f99ef53d

Update CCCL version to v3.2.0-rc2

ORippler committed 12 days ago

b5ec0fd7

server: friendlier error msg when ctx < input (#18174)

am17an committed 13 days ago

Verified cc0a0434

presets: refactor, allow cascade presets from different sources, add global section (#18169)

ngxson committed 13 days ago

Verified 98c1c7a7

Make backend dist sampler use same rnd's as dist sampler

ORippler committed 13 days ago

0a17687c

Fix different RNG-states between backend-sampling and llama-sampling

ORippler committed 13 days ago

17509174

webui: Add editing attachments in user messages (#18147)

allozaur committed 13 days ago

Verified acb73d83

Merge remote-tracking branch 'upstream/master' into backend-sampling

danbev committed 13 days ago

Verified bc5195c5

model-conversion : add verbose flag in run-org-model.py (#18194)

danbev committed 13 days ago

Verified 0a271d82

android: fix missing screenshots for Android.md (#18156)

naco-siren committed 13 days ago

Verified 52fc7fee

vulkan: Add perf logger mode with concurrency (#17944)

jeffbolznv committed 13 days ago

Verified cdbada8d

Newer Older