ngxson/llama.cpp

Pull Requests Commits

fix compilation

ngxson committed 30 days ago

c5faae9a

add some notes about console::log

ngxson committed 30 days ago

9fdf5977

fix llama-completion and mtmd-cli

ngxson committed 30 days ago

ed3fe193

ngxson committed 30 days ago

e135b416

ngxson committed 30 days ago

d00d00a5

implement console writter

ngxson committed 30 days ago

9627d2c0

add warning in mtmd-cli

ngxson committed 31 days ago

a7a3fbe8

simplify common_log_flush

ngxson committed 31 days ago

6defee4a

also clear input files on "/clear"

ngxson committed 31 days ago

2731b4d6

make sure to clean color on force-exit

ngxson committed 31 days ago

7de76974

better loading spinner

ngxson committed 31 days ago

f00041db

properly fix color problem

ngxson committed 31 days ago

3bb5471e

fix merge conflicts

ngxson committed 31 days ago

a03b2af8

Merge branch 'master' into xsn/cli_server_based

ngxson committed 31 days ago

dd660e9e

metal : print node names for debugging (#17882)

ggerganov committed 31 days ago

Verified 6b82eb78

ggml : allow fill node alloc inplace (#17870)

CISC committed 31 days ago

Verified 86a3f0fa

cmake: fix Mach-O current version number (#17877)

Rhys-T committed 31 days ago

Verified 63908b63

model : nit, DeepSeek V1 MoE is 16B and GigaChat is 20B (#12652)

CISC committed 31 days ago

Verified 42b12b56

console: allow using arrow left/right, home/end keys and history mode (#17836)

ngxson committed 31 days ago

Verified 4e842d51

CANN: add support for partial RoPE and Vision mode (#17543)

noemotiovon committed 32 days ago

Verified ca709e42

CUDA: fix FP16 overflow in tile FA kernel (#17875)

JohannesGaessler committed 32 days ago

Verified 0cdce38a

llama : add token matching support to llama-grammar (#17816)

aldehir committed 32 days ago

Verified e39502e7

model : support Rnj-1 (#17811)

philip-essential committed 32 days ago

Verified 1d2a1ab7

graph : use fill instead of scale_bias in grouped expert selection (#17867)

CISC committed 32 days ago

Verified c8554b66

model-conversion : add token ids to prompt token output [no ci] (#17863)

danbev committed 32 days ago

Verified 2fa51c19

server: delegate result_state creation to server_task (#17835)

ngxson committed 32 days ago

Verified 951520dd

ci : support bfloat16 SYCL release package (#17855)

arthw committed 32 days ago

Verified 68522c67

server: improve speed of speculative decoding (#17808)

ngxson committed 32 days ago

Verified f896d2c3

Make graph_max_nodes vary by ubatch size (#17794)

pwilkin committed 32 days ago

Verified e4e9c432

Fix Kimi-K2 tool-call parsing issues (#17376)

hksdpc255 committed 32 days ago

Verified 636fc17a

Older