ngxson/llama.cpp

Pull Requests Commits

server: support global section of presets

ngxson committed 27 days ago

92fd7151

common : add minimalist multi-thread progress bar (#17602)

angt committed 27 days ago

Verified b8ee22cf

cmake: link ws2_32 for MinGW/w64devkit builds in cpp-httplib (#17949)

gustrd committed 27 days ago

Verified 2eaa2c65

HIP: enable mmf for RDNA3 (#17879)

zhang-hui-yulo committed 27 days ago

Verified c33a58bc

Add a search field on model selector / improve mobile display (#17765)

ServeurpersoCom committed 28 days ago

Verified a81a5695

SOLVE_TRI extension to more dimensions (#17793)

pwilkin committed 28 days ago

Verified 53ecd4fd

ggml-alloc : fix reuse-parent logic for misaligned sizes (#17884)

ggerganov committed 28 days ago

Verified c6f6e4f9

batch : fix sequence id ownership (#17915)

ggerganov committed 28 days ago

Verified d9f8f606

docs: use port 8080 in Docker examples (#17903)

utsumi-fj committed 28 days ago

Verified e4ae3833

ggml-hexagon: fix `rope` failure at `test-backend-ops` (#17565)

chraac committed 29 days ago

Verified 34ce48d9

ci: fix riscv64-native build (#17916)

CISC committed 29 days ago

Verified 45e350e3

mtmd: some small clean up (#17909)

ngxson committed 29 days ago

Verified c6b2c931

cli: enable jinja by default (#17911)

ngxson committed 29 days ago

Verified 34a6d869

server: add presets (config) when using multiple models (#17859)

ServeurpersoCom committed 29 days ago

Verified f32ca51b

Fix race conditions in threadpool when dealing with dynamic/frequent n_threads changes (#17748)

max-krasnyansky committed 29 days ago

Verified e1f49219

ggml : remove GGML_KQ_MASK_PAD constant (#17910)

ggerganov committed 29 days ago

Verified 4dff236a

cuda : add missing support check for xielu (#17895)

CISC committed 29 days ago

Verified 4df6e859

cli: new CLI experience (#17824)

ngxson committed 29 days ago

Verified 6c213177

model : Qwen3-Next-80B-A3B has 48 layers (#17898)

EZForever committed 29 days ago

Verified b6777218

docs : update opencl ops (#17904)

lhez committed 29 days ago

Verified 2d2e1030

CUDA: fix unpadded strides in MMA FA kernel (#17891)

JohannesGaessler committed 29 days ago

Verified 17f7f4ba

convert: allow using quantized Mistral weight (#17889)

ngxson committed 29 days ago

Verified 9e79b011

fix softmax for iGPU (#17838)

NeoZhangJianyu committed 29 days ago

Verified 2e9eab80

common : add parser for ministral/mistral large 3/devstral 2 (#17713)

aldehir committed 29 days ago

Verified 2fbe3b7b

docs : update cpu and cuda ops (#17890)

CISC committed 30 days ago

Verified 63391852

metal: SSM kernel improvements (#17876)

gabe-l-hart committed 30 days ago

Verified 086a63e3

Add DIAG for CUDA (#17873)

pwilkin committed 30 days ago

Verified b6350926

docs: clarify that CPU support should be first (#17886)

JohannesGaessler committed 30 days ago

Verified 48f47565

ggml : Provide macos-specific backtrace printing to avoid terminal death (#17869)

gabe-l-hart committed 30 days ago

Verified 02e409a5

metal : print node names for debugging (#17882)

ggerganov committed 30 days ago

Verified 6b82eb78

Older