ngxson/llama.cpp

Pull Requests Commits

Merge branch 'master' into xsn/internvl_batching

ngxson committed 7 hours ago

518e235f

mtmd: add batching for mtmd-cli, add video tests (#24778)

ngxson committed 7 hours ago

Verified a6b3260a

mtmd: add batching support for internvl

ngxson committed 9 hours ago

b57d4efe

cmake : fix ui build with read-only source (#24752)

o7si committed 10 hours ago

Verified 32eddaf2

mtmd: refactor llava-uhd overview image handling (always use ov_img_first) (#24769)

ngxson committed 10 hours ago

Verified 060ce1bf

hexagon: support for op-trace (fine-grain tracing of HVX/HMX/DMA events) (#24592)

max-krasnyansky committed 12 hours ago

Verified d2c67959

docs: fix export-lora --lora-scaled syntax [no release] (#24703)

kkkzbh committed 13 hours ago

Verified 7b6c5a2a

server: (router) fix stopping_thread potentially hang (#24728)

ngxson committed 14 hours ago

Verified fe7c8b24

server: add "schema" and validation (#24150)

ngxson committed 14 hours ago

Verified e1efd099

server : add last-5-seconds generation speed display (#24291)

akx committed 15 hours ago

Verified 08023072

ui: provide touch accessible model selection UI (#24604)

amoshydra committed 16 hours ago

Verified 20832179

server : return HTTP 400 on invalid grammar (#24144) (#24154)

Anuj-Attri committed 17 hours ago

Verified 10786217

server: (router) rework -hf preset repo (#24739)

ngxson committed 17 hours ago

Verified 552258c5

server: fix router args not being forwarded to child instances (#24760)

ngxson committed 17 hours ago

Verified 968c4389

mtmd: refactor preprocessor, add mtmd_image_preproc_out (#24736)

ngxson committed 17 hours ago

Verified 24bba7b9

[SYCL] rename GGML_SYCL_SUPPORT_LEVEL_ZERO (#24719)

arthw committed 19 hours ago

Verified 9724f664

sycl : support MUL_MAT and OUT_PROD with Q1_0 (#24721)

arthw committed 19 hours ago

Verified dd69db29

app : enable self-update only when built with llama-install.sh (#24754)

angt committed 19 hours ago

Verified 6ec59dda

ci : fix check-release message parsing (#24751)

CISC committed 20 hours ago

Verified 32e806b9

[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)

arthw committed 21 hours ago

Verified 6f1034b3

ui: Update code formatting command in pre-commit hook (#24685)

allozaur committed 21 hours ago

Verified 0b73fc79

ci : fix Windows x64 (OpenVINO) release link (#24731)

ravi9 committed 21 hours ago

Verified 4a79037b

metal : check for BF16 support in concat kernel (#24747)

ggerganov committed 21 hours ago

Verified cae0a3b0

mtmd: llava_uhd should no longer use batch dim (#24732)

ngxson committed 1 day ago

Verified f3e18281

ggml-cpu: Conditionally enable power11 backend based on compiler support (#24687)

shalinib-ibm committed 1 day ago

Verified 2e88c49c

metal : implement rope_back operator (#24725)

ggerganov committed 1 day ago

Verified 0843245c

metal : add f16 and bf16 support for concat operator (#24724)

ggerganov committed 1 day ago

Verified 8d2e5806

server: (router) add model management API (#23976)

ngxson committed 1 day ago

Verified 4b4d13ae

llama : skip main_gpu validation when no devices are available (#23405)

Dev-iL committed 1 day ago

Verified b4024af6

spec: fix segfault error on long prompts for eagle3 (#24707)

ruixiang63 committed 1 day ago

Verified 1a2dea29

Older