ngxson/llama.cpp

Pull Requests Commits

Update tools/server/server-context.cpp

ngxson committed 21 days ago

Verified 30a0cb40

server: fix non-bound n_discard value

ngxson committed 21 days ago

c6b7e1b7

mtmd: add batching support for internvl (#24775)

ngxson committed 21 days ago

Verified db52540f

Ggml/cuda col2im 1d (#24417)

ServeurpersoCom committed 21 days ago

Verified 3a3edc9a

server: add "X-Accel-Buffering": "no" header to streaming endpoints (#24774)

regunakyle committed 21 days ago

Verified 40f3aafc

mtmd: add batching for mtmd-cli, add video tests (#24778)

ngxson committed 21 days ago

Verified a6b3260a

cmake : fix ui build with read-only source (#24752)

o7si committed 22 days ago

Verified 32eddaf2

mtmd: refactor llava-uhd overview image handling (always use ov_img_first) (#24769)

ngxson committed 22 days ago

Verified 060ce1bf

hexagon: support for op-trace (fine-grain tracing of HVX/HMX/DMA events) (#24592)

max-krasnyansky committed 22 days ago

Verified d2c67959

docs: fix export-lora --lora-scaled syntax [no release] (#24703)

kkkzbh committed 22 days ago

Verified 7b6c5a2a

server: (router) fix stopping_thread potentially hang (#24728)

ngxson committed 22 days ago

Verified fe7c8b24

server: add "schema" and validation (#24150)

ngxson committed 22 days ago

Verified e1efd099

server : add last-5-seconds generation speed display (#24291)

akx committed 22 days ago

Verified 08023072

ui: provide touch accessible model selection UI (#24604)

amoshydra committed 22 days ago

Verified 20832179

server : return HTTP 400 on invalid grammar (#24144) (#24154)

Anuj-Attri committed 22 days ago

Verified 10786217

server: (router) rework -hf preset repo (#24739)

ngxson committed 22 days ago

Verified 552258c5

server: fix router args not being forwarded to child instances (#24760)

ngxson committed 22 days ago

Verified 968c4389

mtmd: refactor preprocessor, add mtmd_image_preproc_out (#24736)

ngxson committed 22 days ago

Verified 24bba7b9

[SYCL] rename GGML_SYCL_SUPPORT_LEVEL_ZERO (#24719)

arthw committed 22 days ago

Verified 9724f664

sycl : support MUL_MAT and OUT_PROD with Q1_0 (#24721)

arthw committed 22 days ago

Verified dd69db29

app : enable self-update only when built with llama-install.sh (#24754)

angt committed 22 days ago

Verified 6ec59dda

ci : fix check-release message parsing (#24751)

CISC committed 22 days ago

Verified 32e806b9

[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)

arthw committed 22 days ago

Verified 6f1034b3

ui: Update code formatting command in pre-commit hook (#24685)

allozaur committed 22 days ago

Verified 0b73fc79

ci : fix Windows x64 (OpenVINO) release link (#24731)

ravi9 committed 22 days ago

Verified 4a79037b

metal : check for BF16 support in concat kernel (#24747)

ggerganov committed 22 days ago

Verified cae0a3b0

mtmd: llava_uhd should no longer use batch dim (#24732)

ngxson committed 22 days ago

Verified f3e18281

ggml-cpu: Conditionally enable power11 backend based on compiler support (#24687)

shalinib-ibm committed 23 days ago

Verified 2e88c49c

metal : implement rope_back operator (#24725)

ggerganov committed 23 days ago

Verified 0843245c

metal : add f16 and bf16 support for concat operator (#24724)

ggerganov committed 23 days ago

Verified 8d2e5806

Older