ngxson/llama.cpp

Pull Requests Commits

server : add last-5-seconds generation speed display (#24291)

akx committed 11 days ago

Verified 08023072

ui: provide touch accessible model selection UI (#24604)

amoshydra committed 11 days ago

Verified 20832179

server : return HTTP 400 on invalid grammar (#24144) (#24154)

Anuj-Attri committed 11 days ago

Verified 10786217

server: (router) rework -hf preset repo (#24739)

ngxson committed 11 days ago

Verified 552258c5

server: fix router args not being forwarded to child instances (#24760)

ngxson committed 11 days ago

Verified 968c4389

mtmd: refactor preprocessor, add mtmd_image_preproc_out (#24736)

ngxson committed 11 days ago

Verified 24bba7b9

[SYCL] rename GGML_SYCL_SUPPORT_LEVEL_ZERO (#24719)

arthw committed 11 days ago

Verified 9724f664

sycl : support MUL_MAT and OUT_PROD with Q1_0 (#24721)

arthw committed 11 days ago

Verified dd69db29

app : enable self-update only when built with llama-install.sh (#24754)

angt committed 11 days ago

Verified 6ec59dda

ci : fix check-release message parsing (#24751)

CISC committed 11 days ago

Verified 32e806b9

[SYCL] support OPs: conv_2d, conv_2d_dw, conv2d_transpose (#24600)

arthw committed 11 days ago

Verified 6f1034b3

ui: Update code formatting command in pre-commit hook (#24685)

allozaur committed 11 days ago

Verified 0b73fc79

ci : fix Windows x64 (OpenVINO) release link (#24731)

ravi9 committed 11 days ago

Verified 4a79037b

metal : check for BF16 support in concat kernel (#24747)

ggerganov committed 11 days ago

Verified cae0a3b0

mtmd: llava_uhd should no longer use batch dim (#24732)

ngxson committed 11 days ago

Verified f3e18281

ggml-cpu: Conditionally enable power11 backend based on compiler support (#24687)

shalinib-ibm committed 11 days ago

Verified 2e88c49c

metal : implement rope_back operator (#24725)

ggerganov committed 11 days ago

Verified 0843245c

metal : add f16 and bf16 support for concat operator (#24724)

ggerganov committed 11 days ago

Verified 8d2e5806

server: (router) add model management API (#23976)

ngxson committed 11 days ago

Verified 4b4d13ae

llama : skip main_gpu validation when no devices are available (#23405)

Dev-iL committed 11 days ago

Verified b4024af6

spec: fix segfault error on long prompts for eagle3 (#24707)

ruixiang63 committed 11 days ago

Verified 1a2dea29

[SYCL] add dev2dev memcpy by SYCL API (#24476)

arthw committed 11 days ago

Verified 74a80dd9

[SYCL] Add conv_3d (#24691)

arthw committed 11 days ago

Verified d1759e41

webui: export conversations as jsonl (#24688)

julien-c committed 12 days ago

Verified 8086439a

vulkan: record actual memory properties during buffer creation (#24326)

winstonma committed 12 days ago

Verified 558e221b

Revert "cuda: reset cuda context after reading memory size (#23935)" (#24715)

0cc4m committed 12 days ago

Verified ea21e039

ci: fix vulkan docker images (#24595)

Kononnable committed 12 days ago

Verified d5376cf5

UI : fix SSE transport detection and routing through CORS proxy. Assi… (#24500)

hrpnr committed 12 days ago

Verified bae36efa

opencl: optimize mul_mat_f16_f32_l4 for decode (#24504)

lhez committed 12 days ago

Verified 51571722

common: update logging to enforce max_capacity and optimize queue resizing (#24490)

max-krasnyansky committed 12 days ago

Verified cda63856

Newer Older