ngxson/llama.cpp

Pull Requests Commits

server: fix crash with model not having BOS/EOS

ngxson committed 21 days ago

8540fa19

rpc : add check for rpc buffer type (#18242)

struct committed 21 days ago

Verified 12ee1763

ggml-hexagon: create generalized functions for cpu side op (#17500)

chraac committed 22 days ago

Verified ed759777

model-conversion : add trust_remote_code for embedding scripts (#18288)

danbev committed 22 days ago

Verified 847c35f7

[SYCL] replace llama-cli by llama-completion to rm the impact to test script (#18290)

arthw committed 22 days ago

Verified a6a552e4

model : fix div-by-zero for Nemotron V2 (#18309)

Alessandro98-git committed 22 days ago

Verified 96e33a81

model : Granite Embedding support (#15641)

ryan-mangeno committed 22 days ago

Verified dfc959b8

gguf-py : do not align the data start offset (#18291)

compilade committed 22 days ago

Verified 8f488073

ggml-hexagon: gelu optimization (#18151)

joeldushouyu committed 22 days ago

Verified bf6bc3c1

gen-docs: automatically update markdown file (#18294)

ngxson committed 22 days ago

Verified 179fd82a

llamafile: add rvv support for sgemm kernels (#18199)

taimur-10x committed 22 days ago

Verified d34d5ca1

opencl: unpack q4_0 for adreno in get_tensor (#18278)

lhez committed 22 days ago

Verified eb492bf4

vulkan: Extend rope fusions to allow mrope (#18264)

jeffbolznv committed 22 days ago

Verified e3b35ddf

server: prevent data race from HTTP threads (#18263)

ngxson committed 22 days ago

Verified 6ce863c8

server: fix data race in to_json_anthropic (#18283)

ngxson committed 22 days ago

Verified 3997c78e

release: update release workflow to store XCFramework as Zip file (#18284)

mattt committed 22 days ago

Verified ee746429

convert: rework ftype heuristics (#18214)

taronaeo committed 22 days ago

Verified a2831048

server: (docs) remove mention about extra_args (#18262)

ngxson committed 22 days ago

Verified 86af8481

tool/ex/tests: consistently free ctx, then model (#18168)

JohannesGaessler committed 22 days ago

Verified 147a5216

vulkan: Implement set_tensor_async and the event interfaces (#18047)

jeffbolznv committed 23 days ago

Verified e1f15b45

llama: fix RPC for -fit on (#18233)

JohannesGaessler committed 23 days ago

Verified 0e1ccf15

move copilot instructions to AGENTS.md (#18259)

ngxson committed 23 days ago

Verified 5e25ddeb

vulkan: fix im2col overflowing maxworkgroupcount (#18180)

jeffbolznv committed 23 days ago

Verified fd05c51c

vulkan/cuda: fix topk_moe with exp_probs_b (#18071)

jeffbolznv committed 24 days ago

Verified b365c3ff

vulkan: support GGML_UNARY_OP_XIELU (#18062)

jeffbolznv committed 24 days ago

Verified cb64222b

vulkan: in graph_optimize, try to group ADD operations (#18060)

jeffbolznv committed 24 days ago

Verified 6eb70818

Vulkan: some improvement on mul_mat_iq2_xs (#18031)

lovedheart committed 24 days ago

Verified 4117ae55

docs : fix links in parsing.md (#18245)

danbev committed 24 days ago

Verified 65e96a24

common : reorganize includes to prioritize vendored deps (#18222)

aldehir committed 24 days ago

Verified 9496bbb8

server: add auto-sleep after N seconds of idle (#18228)

ngxson committed 24 days ago

Verified ddcb75dd

Older