ngxson/llama.cpp

Pull Requests Commits

ngxson committed 33 days ago

bb123af0

improve maybe_load_it_why_not

ngxson committed 34 days ago

2a200683

fully working model maganement

ngxson committed 34 days ago

7a7de2a2

ngxson committed 35 days ago

016f8b40

move the chat template print to init()

ngxson committed 35 days ago

2c9fe91e

add req.headers

ngxson committed 35 days ago

68d5c6f8

more generic handler

ngxson committed 35 days ago

4d37cee5

bring back the "server is listening on" message

ngxson committed 36 days ago

55ccf46b

improve usage of next()

ngxson committed 36 days ago

1bc41f60

Merge branch 'master' into xsn/split_http_server_context

ngxson committed 36 days ago

8dbe547b

model : add AfmoeForCausalLM support (#16477)

bartowski1182 committed 36 days ago

Verified e1fcf8b0

fix : Dangling pointer for non-empty trigger words in lazy grammar construction (#17048)

marek-hradil committed 36 days ago

Verified 6cd0cf72

server : fix "can batch with" bug (#17263)

ggerganov committed 36 days ago

Verified d396b437

metal : support argsort for ne00 > 1024 (#17247)

ggerganov committed 36 days ago

Verified 45c6ef73

metal : make the FA extra sizes consistent (#17143)

ggerganov committed 36 days ago

Verified 2606b0ad

readme : add RVV,ZVFH,ZFH,ZICBOP support for RISC-V (#17259)

ixgbe committed 36 days ago

Verified 307772fc

Better UX for handling multiple attachments in WebUI (#17246)

allozaur committed 36 days ago

Verified f1bad23f

ggml-cpu: handle 3d tensors in repack mat_mul (#17241)

Alcpz committed 37 days ago

Verified becc4816

server: fixing naming conflict res_error (#17243)

ngxson committed 37 days ago

Verified c4abcb24

ggml : add ops SOFTPLUS, EXPM1, TRI, SOLVE_TRI, CUMSUM (#17063)

pwilkin committed 37 days ago

Verified 389ac78b

vulkan: remove shell call from vulkan-shaders-gen tool, revert file check (#17219)

0cc4m committed 37 days ago

Verified a19bd6f7

sched : fix reserve ignoring user tensor assignments (#17232)

slaren committed 37 days ago

Verified dd091e52

ggml-cpu : add RISC-V vector intrinsic support for silu and cvar operations (#17227)

ixgbe committed 37 days ago

Verified 1215dde7

metal: accelerated conv2d (#17175)

bghira committed 37 days ago

Verified 0cfb1916

Revert "ggml-cpu: handle 3d tensors in repack mat_mul (#17030)" (#17233)

ggerganov committed 37 days ago

Verified 2776db6c

add some comments

ngxson committed 37 days ago

cd104700

ngxson committed 37 days ago

da458d68

use safe_json_to_str for SSE

ngxson committed 37 days ago

8c7fbec4

do not call sink.write on empty data

ngxson committed 37 days ago

fc35e916

ggml-cpu : use template for argsort (#17222)

slaren committed 37 days ago

Verified 879dec34

Older