ngxson/llama.cpp

Pull Requests Commits

server: add SSE ping interval

ngxson committed 91 days ago

23e6dab8

speculative : fix n_outputs_max and remove draft-simple auto-enable (#23988)

ggerganov committed 91 days ago

Verified 5dcb7116

nix : add nix-nodejs facilities to build Web UI (#23846)

choener committed 91 days ago

Verified 5aa3a645

opencl: add basic support for q5_0 and q5_1 (#23548)

shaofeiqi committed 92 days ago

Verified 27d9ed83

vendor : update cpp-httplib to 0.46.1 (#23980)

angt committed 92 days ago

Verified 335abed1

llama: limit max outputs of `llama_context` (#23861)

am17an committed 92 days ago

Verified de6f727a

metal: template GLU kernels to support f16/f32 (#23882)

shrivasshankar committed 92 days ago

Verified 95b8b8ec

vulkan: don't hold the device mutex while compiling pipelines (#23641)

jeffbolznv committed 92 days ago

Verified 55ac0909

vulkan: reduce host memory lock contention (#23376)

winstonma committed 92 days ago

Verified bef69f13

vocab: add normalizer.lowercase support to WPM (#23899)

o7si committed 92 days ago

Verified 5aba5364

TP: quantized KV cache support (#23792)

JohannesGaessler committed 92 days ago

Verified 8e6fff84

security : disable private disclosures (#23963)

ggerganov committed 92 days ago

Verified 02a57017

model: Add EXAONE 4.5 implementations (#21733)

nuxlear committed 92 days ago

Verified 48b88c3b

vulkan: Block-load Q3_K/Q6_K block data and subtract on 32b ints (#23056)

TheBlueMatt committed 92 days ago

Verified 19620004

vulkan: Removed unused functions (#23175)

winstonma committed 92 days ago

Verified f8c0a19d

common : support manually triggering the reasoning budget end sequence (#23949)

aldehir committed 92 days ago

Verified 5254a799

ci : add missing Linux label to cpu-x64-high-perf runner (#23958)

ggerganov committed 92 days ago

Verified e22b0de6

[SYCL] Support Q4_1, Q5_0, Q5_1 in Flash-attention (#23812)

arthw committed 92 days ago

Verified a5114249

[SYCL] Add more types in GET_ROWS OP (#23710)

arthw committed 92 days ago

Verified 41625226

sycl : Optimize Q3_K mul_mat by reorder (#23725)

arthw committed 92 days ago

Verified 44e211ce

ci: remove redundant or duplicate jobs (#23927)

netrunnereve committed 92 days ago

Verified af6528e6

server : handle If-None-Match weak ETags (#23916)

EZForever committed 92 days ago

Verified 6f165c1c

ci : limit trigger paths for the CPU workflow (#23938)

ggerganov committed 93 days ago

Verified 399739d5

vocab : add tokenizer support for jina-embeddings-v2-base-zh (#18756)

o7si committed 93 days ago

Verified d4c8e2c2

ui: fix ETag truncation with MSVC compiler (#23917)

EZForever committed 93 days ago

Verified 3292da09

docs : update ZenDNN docs for Q8 support (#23791)

truecoder34 committed 93 days ago

Verified e6123e20

llama: only use one iGPU device by default (#23897)

0cc4m committed 93 days ago

Verified 22cadc19

webui: add custom CSS injection via config (#23904)

ServeurpersoCom committed 93 days ago

Verified d749821d

Support `-fa auto` in llama-bench (#23714)

gaugarg-nv committed 93 days ago

Verified aa46bda8

opencl: support bf16 by converting to f16 (#23839)

lhez committed 94 days ago

Verified d6588daa

Older