ngxson/llama.cpp

Pull Requests Commits

ngxson committed 17 days ago

4cf77599

fix non-batching case

ngxson committed 17 days ago

b3a5ca93

ngxson committed 18 days ago

0d6bc77d

ngxson committed 18 days ago

67d43350

ngxson committed 18 days ago

de656cc3

ngxson committed 18 days ago

2dd581ae

fix 0.0 output embd

ngxson committed 18 days ago

7a22484c

wire up support_batch()

ngxson committed 18 days ago

3eecd674

ngxson committed 18 days ago

a773d7b8

ngxson committed 18 days ago

190bef3b

first working version (gemma4v)

ngxson committed 19 days ago

f77cfd73

Merge branch 'master' into xsn/mtmd_batch_api

ngxson committed 19 days ago

eb2dab2f

ngxson committed 19 days ago

111d3f17

server: skip unused log lines on router mode (#24463)

ngxson committed 19 days ago

Verified 18ef86ec

vocab : adopt leading TemplateProcessing special token as BOS (#24428)

o7si committed 19 days ago

Verified 1bfbdb13

vocab : refactor normalizer flags into options struct, add strip_accents (#24371)

o7si committed 19 days ago

Verified 68f30663

server : skip checkpoints beyond pos_next (#24411)

aldehir committed 19 days ago

Verified db94854f

vendor : update LibreSSL to 4.3.2 (#24397)

angt committed 19 days ago

Verified ac4cddeb

Remove padding and multiple D2D copies for MTP (#24086)

gaugarg-nv committed 19 days ago

Verified e95dae18

chat: fix LFM2/LFM2.5 ignoring json_schema (#24377)

tdakhran committed 20 days ago

Verified d2462f8f

CUDA: Fix ssm_scan_f32 data-races (#24360)

ORippler committed 20 days ago

Verified fb83cc9a

ci : bump komac version (#24396)

CISC committed 20 days ago

Verified 039e20a2

speculative : fix "ngram-map-k4v" name in logging (#24253)

ddh0 committed 20 days ago

Verified d2e22ed9

mtmd: add batching API

ngxson committed 20 days ago

b62c3051

webui: implement pinned conversations support (#21387)

remeh committed 20 days ago

Verified 76da2450

graph: Fix granite speech model inference by applying embedding scale when deepstack is not used (#24357)

arnu515 committed 20 days ago

Verified d73cd076

ci : fix windows release (#24369)

CISC committed 20 days ago

Verified e25a32e9

ui: add opt-in run_javascript frontend tool (#24244)

ServeurpersoCom committed 20 days ago

Verified 48360950

mtmd: build_vit batching (#24352)

sfallah committed 20 days ago

Verified 49f35421

vulkan: reduce iq1 shared memory usage for mul_mm (#24287)

jeffbolznv committed 21 days ago

Verified d6d0ce82

Older