ggerganov/llama.cpp

Pull Requests Commits

address review comments

ngxson committed 10 days ago

fbb29b3f

fix stream case

ngxson committed 10 days ago

3954a9c3

ngxson committed 10 days ago

07491664

handle coalescing (req leaves waiting queue)

ngxson committed 10 days ago

3bf32c0a

ngxson committed 10 days ago

02f5052f

server: (router) do not evict busy models (#26567)

ngxson committed 10 days ago

Verified e1470ee6

mtmd: stop feeding the text stream again during Qwen3-TTS generation (#26706)

ServeurpersoCom committed 10 days ago

Verified 217df17a

ggml : add aarch64 HWCAP fallbacks and fix fp16 variant detection (#25554)

kilian-hu committed 10 days ago

Verified cb26014d

ui: read model modalities from the router model list (#26709)

ServeurpersoCom committed 10 days ago

Verified 82bb4850

Mitigate crashing issue on Windows MSYS2 UCRT64 environment (GCC 16.1.0) (#26555)

rillomas committed 10 days ago

Verified 42e98813

sycl: fix UE4M3 parsing (#25608)

clee committed 10 days ago

Verified fc3f10b3

sycl: *glu flat path (#26354)

Titaniumtown committed 10 days ago

Verified 6b5c2efb

sycl : Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE (#26568)

arthw committed 10 days ago

Verified 31558dbb

sycl : update guide Q&A and script for device setting (#26442)

arthw committed 10 days ago

Verified c1f41098

sycl : fix error Error OP FLASH_ATTN_EXT on arc770 (#26441)

arthw committed 10 days ago

Verified eef5f3e3

sycl : enhance OP set_rows to support all missed data types (#26515)

arthw committed 10 days ago

Verified c074cb3f

cuda: fix warnings for unused variable/function (#26688)

dfriehs committed 10 days ago

Verified 5b87ed30

ci: abort if build requirements are missing (#26368)

nikwen committed 10 days ago

Verified d8d98872

metal : avoid `threadgroup` matrix array instantiation in kernel_lightning_indexer (#26646)

JamePeng committed 10 days ago

Verified e40bf886

mtmd: add chunk save/load function (#26645)

ngxson committed 10 days ago

Verified 15586e2d

server: fix empty response for /cors-proxy (#26656)

ngxson committed 11 days ago

Verified 6a32c29a

convert : fix DeepseekV4 rope parameters with transformers 5.x (#26673)

CISC committed 11 days ago

Verified eb5667a1

model-loader : fix quantized reshaped tensor strides (#26672)

ggerganov committed 11 days ago

Verified 3db4ff87

convert : accept "ExaoneMoeForCausalLM" arch spelling (#26660)

csabakecskemeti committed 11 days ago

Verified e700bfb3

ci : onboard AMD ROCm CI with gfx1151 fixes (#26544)

jimw567 committed 11 days ago

Verified a1f96d4f

model-conversion : add --model-name to conversion scripts (#26665)

danbev committed 11 days ago

Verified 9de0fcf2

vulkan: fix submission batching size, add debug tools for diagnosing causes of DeviceLost drivers errors (#26371)

0cc4m committed 11 days ago

Verified 803b7fca

mtmd/ggml: add ggml_build_forward_order (#26649)

ServeurpersoCom committed 11 days ago

Verified c8e03ce8

server: harden the file_glob_search directory walk (#26626)

ServeurpersoCom committed 11 days ago

Verified f9e832c1

tests: re-enable MiniMax M3 in `test-llama-archs` (#26633)

nikwen committed 11 days ago

Verified 360e1349

Older