ngxson/llama.cpp

Pull Requests Commits

if file doesn't exist, respect skip_download flag

ngxson committed 112 days ago

ec6a687c

ngxson committed 112 days ago

0c332aab

ngxson committed 112 days ago

57b29c63

Merge branch 'master' into xsn/opt_skip_download

ngxson committed 112 days ago

59927a60

vulkan: fix windows find_package of SPIRV-Headers (#23215)

jeffbolznv committed 112 days ago

Verified 95405ac6

opencl: generalize Adreno MoE kernels on M (#23449)

shawngu-quic committed 113 days ago

Verified 0f3cb3fc

server: only parse empty msg if continuing an assistant msg (#23506)

aldehir committed 113 days ago

Verified 1acee6bf

perplexity : fix integer overflow (#23496)

fairydreaming committed 113 days ago

Verified ef570f63

SYCL: improve MoE prefill throughput (#23142)

sanmai committed 113 days ago

Verified cc9e3312

sycl : Level Zero detection in ggml_sycl_init (#23097)

sanmai committed 113 days ago

Verified bcfd1989

SYCL : gated_delta_net K>1 (#23174)

karavayev committed 113 days ago

Verified 56f16f23

SYCL: add BF16 to DMMV kernel path (~4x tg speedup on Intel Arc) (#21580)

PMZFX committed 113 days ago

Verified 8cc67efc

docs: Update documentation with Granite 4.0/4.1 (#23404)

jesus-talavera-ibm committed 113 days ago

Verified 95feeab5

ggml-zendnn : add Q8_0 quantization support (#23414)

z-sachin committed 113 days ago

Verified 99d4026b

cmake : build router app only during standalone builds (#23521)

fairydreaming committed 113 days ago

Verified 9c92e96a

vocab : fix HybridDNA tokenizer (#23466)

kashif committed 113 days ago

Verified afcda09d

cmake : add install() for impl libraries + fix apple builds (#23511)

ggerganov committed 113 days ago

Verified bbce619a

CUDA: fix PDL CC check for JIT compilation (#23471)

JohannesGaessler committed 114 days ago

Verified 4f0e43da

cmake : remove STATIC from impl libraries, enable LLAMA_BUILD_APP by default (#23462)

ggerganov committed 114 days ago

Verified bb28c1fe

Update WebGPU support and add link to blog/demo (#23483)

reeselevine committed 114 days ago

Verified ee7c3057

vulkan: fuse snake activation (mul, sin, sqr, mul, add) (#22855)

ServeurpersoCom committed 114 days ago

Verified 47c0eda9

fix(flash-attn): replace f32 with kv_type and q_type (#23372)

Constannnnnt committed 114 days ago

Verified 5306f4b3

tests : move save-load-state from examples to tests (#23336)

ggerganov committed 114 days ago

Verified 40d5358d

server: expose prompt token counts in /slots endpoint (#23454)

ScrewTSW committed 114 days ago

Verified b65bb4ba

metal : optimize concat kernel and fix set kernel threads (#23411)

ggerganov committed 114 days ago

Verified a1a69f77

server : free draft/MTP resources on sleep to fix VRAM leak (#23461)

am17an committed 114 days ago

Verified 52fb93a2

server: re-inject subcommand when router spawns children under unified binary (#23442)

ServeurpersoCom committed 114 days ago

Verified c9021714

app : add batched-bench, fit-params, quantize & perplexity (#23459)

angt committed 115 days ago

Verified 1d7ab2b9

mtp: use inp_out_ids for skipping logit computation (#23433)

am17an committed 115 days ago

Verified 12e5d990

vocab : add Carbon-3B (HybridDNATokenizer) support (#23410)

kashif committed 115 days ago

Verified 7ea23ddf

Older