ngxson/llama.cpp

Pull Requests Commits

mtmd: add batching for mtmd-cli, add video tests

ngxson committed 26 days ago

fec1a858

mtmd: refactor llava-uhd overview image handling (always use ov_img_first) (#24769)

ngxson committed 26 days ago

Verified 060ce1bf

hexagon: support for op-trace (fine-grain tracing of HVX/HMX/DMA events) (#24592)

max-krasnyansky committed 26 days ago

Verified d2c67959

docs: fix export-lora --lora-scaled syntax [no release] (#24703)

kkkzbh committed 26 days ago

Verified 7b6c5a2a

server: (router) fix stopping_thread potentially hang (#24728)

ngxson committed 26 days ago

Verified fe7c8b24

server: add "schema" and validation (#24150)

ngxson committed 26 days ago

Verified e1efd099

server : add last-5-seconds generation speed display (#24291)

akx committed 26 days ago

Verified 08023072

ui: provide touch accessible model selection UI (#24604)

amoshydra committed 26 days ago

Verified 20832179

server : return HTTP 400 on invalid grammar (#24144) (#24154)

Anuj-Attri committed 26 days ago

Verified 10786217

server: (router) rework -hf preset repo (#24739)

ngxson committed 26 days ago

Verified 552258c5

server: fix router args not being forwarded to child instances (#24760)

ngxson committed 26 days ago

Verified 968c4389

mtmd: refactor preprocessor, add mtmd_image_preproc_out (#24736)

ngxson committed 26 days ago

Verified 24bba7b9

[SYCL] rename GGML_SYCL_SUPPORT_LEVEL_ZERO (#24719)

arthw committed 26 days ago

Verified 9724f664

sycl : support MUL_MAT and OUT_PROD with Q1_0 (#24721)

arthw committed 26 days ago

Verified dd69db29

app : enable self-update only when built with llama-install.sh (#24754)

angt committed 26 days ago

Verified 6ec59dda

ci : fix check-release message parsing (#24751)

CISC committed 26 days ago

Verified 32e806b9

[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)

arthw committed 26 days ago

Verified 6f1034b3

ui: Update code formatting command in pre-commit hook (#24685)

allozaur committed 26 days ago

Verified 0b73fc79

ci : fix Windows x64 (OpenVINO) release link (#24731)

ravi9 committed 26 days ago

Verified 4a79037b

metal : check for BF16 support in concat kernel (#24747)

ggerganov committed 26 days ago

Verified cae0a3b0

mtmd: llava_uhd should no longer use batch dim (#24732)

ngxson committed 27 days ago

Verified f3e18281

ggml-cpu: Conditionally enable power11 backend based on compiler support (#24687)

shalinib-ibm committed 27 days ago

Verified 2e88c49c

metal : implement rope_back operator (#24725)

ggerganov committed 27 days ago

Verified 0843245c

metal : add f16 and bf16 support for concat operator (#24724)

ggerganov committed 27 days ago

Verified 8d2e5806

server: (router) add model management API (#23976)

ngxson committed 27 days ago

Verified 4b4d13ae

llama : skip main_gpu validation when no devices are available (#23405)

Dev-iL committed 27 days ago

Verified b4024af6

spec: fix segfault error on long prompts for eagle3 (#24707)

ruixiang63 committed 27 days ago

Verified 1a2dea29

[SYCL] add dev2dev memcpy by SYCL API (#24476)

arthw committed 27 days ago

Verified 74a80dd9

[SYCL] Add conv_3d (#24691)

arthw committed 27 days ago

Verified d1759e41

webui: export conversations as jsonl (#24688)

julien-c committed 27 days ago

Verified 8086439a

Older