ngxson/llama.cpp

Pull Requests Commits

model : Qwen3-Next-80B-A3B has 48 layers (#17898)

EZForever committed 81 days ago

Verified b6777218

docs : update opencl ops (#17904)

lhez committed 81 days ago

Verified 2d2e1030

CUDA: fix unpadded strides in MMA FA kernel (#17891)

JohannesGaessler committed 81 days ago

Verified 17f7f4ba

convert: allow using quantized Mistral weight (#17889)

ngxson committed 81 days ago

Verified 9e79b011

fix softmax for iGPU (#17838)

NeoZhangJianyu committed 81 days ago

Verified 2e9eab80

common : add parser for ministral/mistral large 3/devstral 2 (#17713)

aldehir committed 81 days ago

Verified 2fbe3b7b

docs : update cpu and cuda ops (#17890)

CISC committed 81 days ago

Verified 63391852

metal: SSM kernel improvements (#17876)

gabe-l-hart committed 81 days ago

Verified 086a63e3

Add DIAG for CUDA (#17873)

pwilkin committed 81 days ago

Verified b6350926

docs: clarify that CPU support should be first (#17886)

JohannesGaessler committed 81 days ago

Verified 48f47565

ggml : Provide macos-specific backtrace printing to avoid terminal death (#17869)

gabe-l-hart committed 82 days ago

Verified 02e409a5

metal : print node names for debugging (#17882)

ggerganov committed 82 days ago

Verified 6b82eb78

ggml : allow fill node alloc inplace (#17870)

CISC committed 82 days ago

Verified 86a3f0fa

cmake: fix Mach-O current version number (#17877)

Rhys-T committed 82 days ago

Verified 63908b63

model : nit, DeepSeek V1 MoE is 16B and GigaChat is 20B (#12652)

CISC committed 82 days ago

Verified 42b12b56

console: allow using arrow left/right, home/end keys and history mode (#17836)

ngxson committed 82 days ago

Verified 4e842d51

CANN: add support for partial RoPE and Vision mode (#17543)

noemotiovon committed 82 days ago

Verified ca709e42

CUDA: fix FP16 overflow in tile FA kernel (#17875)

JohannesGaessler committed 82 days ago

Verified 0cdce38a

llama : add token matching support to llama-grammar (#17816)

aldehir committed 82 days ago

Verified e39502e7

model : support Rnj-1 (#17811)

philip-essential committed 82 days ago

Verified 1d2a1ab7

graph : use fill instead of scale_bias in grouped expert selection (#17867)

CISC committed 82 days ago

Verified c8554b66

model-conversion : add token ids to prompt token output [no ci] (#17863)

danbev committed 83 days ago

Verified 2fa51c19

server: delegate result_state creation to server_task (#17835)

ngxson committed 83 days ago

Verified 951520dd

ci : support bfloat16 SYCL release package (#17855)

arthw committed 83 days ago

Verified 68522c67

server: improve speed of speculative decoding (#17808)

ngxson committed 83 days ago

Verified f896d2c3

Make graph_max_nodes vary by ubatch size (#17794)

pwilkin committed 83 days ago

Verified e4e9c432

Fix Kimi-K2 tool-call parsing issues (#17376)

hksdpc255 committed 83 days ago

Verified 636fc17a

cuda : add FILL op support (#17851)

JayZenith committed 83 days ago

Verified 51e0c2d9

server : add development documentation (#17760)

ngxson committed 83 days ago

Verified 37a4f632

server : make cache_reuse configurable per request (#17858)

ggerganov committed 83 days ago

Verified 2bc96931

Newer Older