ngxson/llama.cpp

Pull Requests Commits

customizable proxy host

ngxson committed 53 days ago

dc6592c0

add req.headers

ngxson committed 53 days ago

289aa9a3

Merge branch 'xsn/split_http_server_context' into xsn/poc_proxy_2

ngxson committed 53 days ago

92b593ea

move the chat template print to init()

ngxson committed 53 days ago

2c9fe91e

add req.headers

ngxson committed 53 days ago

68d5c6f8

more generic handler

ngxson committed 53 days ago

4d37cee5

handle all error cases

ngxson committed 54 days ago

9afb23b3

bring back the "server is listening on" message

ngxson committed 54 days ago

55ccf46b

PoC proxy with stream support

ngxson committed 54 days ago

4258c23b

improve usage of next()

ngxson committed 55 days ago

1bc41f60

Merge branch 'master' into xsn/split_http_server_context

ngxson committed 55 days ago

8dbe547b

model : add AfmoeForCausalLM support (#16477)

bartowski1182 committed 55 days ago

Verified e1fcf8b0

fix : Dangling pointer for non-empty trigger words in lazy grammar construction (#17048)

marek-hradil committed 55 days ago

Verified 6cd0cf72

server : fix "can batch with" bug (#17263)

ggerganov committed 55 days ago

Verified d396b437

metal : support argsort for ne00 > 1024 (#17247)

ggerganov committed 55 days ago

Verified 45c6ef73

metal : make the FA extra sizes consistent (#17143)

ggerganov committed 55 days ago

Verified 2606b0ad

readme : add RVV,ZVFH,ZFH,ZICBOP support for RISC-V (#17259)

ixgbe committed 55 days ago

Verified 307772fc

Better UX for handling multiple attachments in WebUI (#17246)

allozaur committed 55 days ago

Verified f1bad23f

ggml-cpu: handle 3d tensors in repack mat_mul (#17241)

Alcpz committed 55 days ago

Verified becc4816

server: fixing naming conflict res_error (#17243)

ngxson committed 55 days ago

Verified c4abcb24

ggml : add ops SOFTPLUS, EXPM1, TRI, SOLVE_TRI, CUMSUM (#17063)

pwilkin committed 55 days ago

Verified 389ac78b

vulkan: remove shell call from vulkan-shaders-gen tool, revert file check (#17219)

0cc4m committed 56 days ago

Verified a19bd6f7

sched : fix reserve ignoring user tensor assignments (#17232)

slaren committed 56 days ago

Verified dd091e52

ggml-cpu : add RISC-V vector intrinsic support for silu and cvar operations (#17227)

ixgbe committed 56 days ago

Verified 1215dde7

metal: accelerated conv2d (#17175)

bghira committed 56 days ago

Verified 0cfb1916

Revert "ggml-cpu: handle 3d tensors in repack mat_mul (#17030)" (#17233)

ggerganov committed 56 days ago

Verified 2776db6c

add some comments

ngxson committed 56 days ago

cd104700

ngxson committed 56 days ago

da458d68

use safe_json_to_str for SSE

ngxson committed 56 days ago

8c7fbec4

do not call sink.write on empty data

ngxson committed 56 days ago

fc35e916

Older