ngxson/llama.cpp

Pull Requests Commits

ngxson committed 42 days ago

2c3fa50e

server: enable jinja by default, update docs

ngxson committed 42 days ago

2306312a

ggml-cpu : add RISC-V Zvfh impl for ggml_vec_mad_f16 (#17448)

xctan committed 42 days ago

Verified 6ab4e50d

cmake : use EXCLUDE_FROM_ALL to avoid patch-boringssl.cmake (#17520)

angt committed 42 days ago

Verified 2336cc47

ggml : fix ARM feature verification (#17519)

angt committed 42 days ago

Verified e6923caa

HIP: Patch failed testcase in WMMA-MMQ kernels for RDNA 4 (#17502)

jiachengjason committed 42 days ago

Verified 3e18dba9

CANN: Add MROPE and IMROPE support (#17401)

hipudding committed 42 days ago

Verified eeb5605d

chore: upgrade cpp-httplib from v0.27.0 to v0.28.0 (#17513)

o7si committed 42 days ago

Verified f3a848a3

vulkan: Implement GGML_OP_CUMSUM (#17479)

jeffbolznv committed 42 days ago

Verified b3b03a7b

ggml : add ggml_top_k (#17365)

ggerganov committed 43 days ago

Verified 583cb834

convert : fix big-endian conversion (#17431)

AlekseiNikiforovIBM committed 43 days ago

Verified 05872ac8

codeowners : remove slaren (#17492)

slaren committed 43 days ago

Verified 55ab25ca

CANN: supports out_prod operator for F32 and F16 (#17406)

TianHao324 committed 43 days ago

Verified 064c90d8

webui: add rehype plugin to restore HTML in Markdown table cells (#17477)

ServeurpersoCom committed 43 days ago

Verified b1846f1c

vulkan: Use fewer rows for scalar FA when HS is not a multiple of 16 (#17455)

jeffbolznv committed 43 days ago

Verified d414db02

llama: introduce support for model-embedded sampling parameters (#17120)

taronaeo committed 43 days ago

Verified 877566d5

vulkan: more FA details in vk_perf_logger (#17443)

jeffbolznv committed 43 days ago

Verified 3d07caa9

llama : skip output reordering for single token batches (#17466)

danbev committed 43 days ago

Verified 134e6940

HIP: WMMA-MMQ kernels for RDNA 4 (#17156)

jiachengjason committed 44 days ago

Verified 0543f928

convert : allow quantizing lora again (#17453)

CISC committed 44 days ago

Verified b61de2b2

server: split server.cpp code into server/common/task/queue (#17362)

ngxson committed 44 days ago

Verified b8372eec

examples : add -kvu to batched usage example [no ci] (#17469)

danbev committed 44 days ago

Verified 6ab8eacd

ggerganov committed 44 days ago

2d50b9d8

ggml : remove dirty flag from version string (ggml/1391)

danbev committed 44 days ago

697edfee

ggml-cpu: arm64: q4_K repack gemm and gemv implementations (i8mm) (#16739)

Alcpz committed 44 days ago

Verified dbb852b5

ggml: add RISC-V cpu-feats (#17461)

ixgbe committed 44 days ago

Verified 5f55c385

models : Added support for RND1 Diffusion Language Model (#17433)

wp4032 committed 44 days ago

Verified 4902eebe

hexagon: add support for ROPE_NEOX (#17458)

max-krasnyansky committed 44 days ago

Verified 923ae3c6

CANN: Define `cann_graph_update_required` before macro (#17434)

rauletorresc committed 44 days ago

Verified 01ad35e6

ggml-hexagon: Initial Hexagon v68/v69 support (#17394)

mediouni-m committed 44 days ago

Verified fcb01384

Older