ngxson/llama.cpp

Pull Requests Commits

nits: correct naming for json_webui_settings

ngxson committed 47 days ago

b1b8098c

nits: revert redundant changes

ngxson committed 47 days ago

ab20c9fe

nits: fix shadow variable

ngxson committed 47 days ago

982eda7b

fix data race for lora endpoint

ngxson committed 48 days ago

35a3bc3e

fix index handling buggy

ngxson committed 48 days ago

1eb29d7d

ngxson committed 48 days ago

ed1f6ad5

http: make sure req & res lifecycle are tied together

ngxson committed 48 days ago

121c7e77

move index to be managed by server_response_reader

ngxson committed 48 days ago

8124b226

fix GGML_ASSERT(idx < states.size())

ngxson committed 48 days ago

db091cd1

ngxson committed 48 days ago

c417b6d2

nits: make handle_completions_impl looks less strange

ngxson committed 48 days ago

b0e5ee69

fix default_generation_settings

ngxson committed 48 days ago

7406d683

ngxson committed 48 days ago

d957b3d1

server: prevent data race from HTTP threads

ngxson committed 48 days ago

3d64c3bc

vulkan: fix im2col overflowing maxworkgroupcount (#18180)

jeffbolznv committed 48 days ago

Verified fd05c51c

vulkan/cuda: fix topk_moe with exp_probs_b (#18071)

jeffbolznv committed 48 days ago

Verified b365c3ff

vulkan: support GGML_UNARY_OP_XIELU (#18062)

jeffbolznv committed 48 days ago

Verified cb64222b

vulkan: in graph_optimize, try to group ADD operations (#18060)

jeffbolznv committed 48 days ago

Verified 6eb70818

Vulkan: some improvement on mul_mat_iq2_xs (#18031)

lovedheart committed 48 days ago

Verified 4117ae55

docs : fix links in parsing.md (#18245)

danbev committed 48 days ago

Verified 65e96a24

common : reorganize includes to prioritize vendored deps (#18222)

aldehir committed 49 days ago

Verified 9496bbb8

server: add auto-sleep after N seconds of idle (#18228)

ngxson committed 49 days ago

Verified ddcb75dd

tests: Avoid floating point precision false positives in SUM (#17471)

jeffbolznv committed 49 days ago

Verified 52ab19df

test-backend-ops: improve msvc build time (#18209)

jeffbolznv committed 49 days ago

Verified 5182dd64

Added comments explaining thread block size selection logic based on row count and column size, derived from historical commit context (#18212)

Aadeshveer committed 49 days ago

Verified 10b4f82d

server : [easy] fix per round speculative decode logging (#18211)

okuvshynov committed 49 days ago

Verified 408616ad

server: support load model on startup, support preset-only options (#18206)

ngxson committed 49 days ago

Verified 9e39a1e6

ci : remove non-windows zip artifacts (#18201)

CISC committed 50 days ago

Verified 74e05131

ci : only save ccache on master (#18207)

CISC committed 50 days ago

Verified f74747d8

ggml-hexagon: Implement true Q8_0 quantization on Hexagon NPU for more accurate mixed-precision matmul operations (#17977)

ngdxzy committed 50 days ago

Verified ce734a8a

Older