ggerganov/llama.cpp

Pull Requests Commits

ci: add pr-draft-label

ngxson committed 29 days ago

35d61003

ggml-cpu : fix missing Q5_0 dispatch in SpaceMiT backend (#26792)

Hao-Chen2337 committed 29 days ago

Verified 08659901

ci: rm `GGML_HIP_ROCWMMA_FATTN` (#26760)

taronaeo committed 29 days ago

Verified 61141f14

server: report the isolate working directory from get_info (#26773)

ServeurpersoCom committed 29 days ago

Verified 7ba604f1

CUDA: fuse rms_norm + mul + rope (+ view + set_rows) (#26767)

grafail committed 30 days ago

Verified 687e7789

server, ui: only offer a working directory when a tool reads it (#26762)

ServeurpersoCom committed 30 days ago

Verified 18f7ad7f

server: add initial tool isolation support (via docker) (#26507)

ngxson committed 30 days ago

Verified dd2c7c44

CUDA: fix thread/block count in quantized cpy kernel launches (#26731)

grafail committed 30 days ago

Verified 69bf6437

tts: account for the vocoder pass in the timings line (#26733)

ServeurpersoCom committed 30 days ago

Verified 3653e6d6

allozaur/feat/chat form contenteditable (#26717)

ServeurpersoCom committed 30 days ago

Verified fc6545d3

tests : speed-up server test suite 3x (#26734)

ggerganov committed 30 days ago

Verified 1621a3d3

allozaur/feat/chat slash commands (#26716)

ServeurpersoCom committed 30 days ago

Verified 6de1b634

sycl: coalesce the ssm_conv window loads (#26612)

Titaniumtown committed 30 days ago

Verified f8e30266

metal : fix NORM/RMS_NORM for row lengths that leave a partial simdgroup (#26708)

robertomeroni committed 30 days ago

Verified a194a75b

ui: Filesystem `@mentions` for Chat Form (#26715)

ServeurpersoCom committed 30 days ago

Verified 23634783

mtmd: fix longest_edge ignoring min/max pixels (#26638)

ngxson committed 31 days ago

Verified 4cb22cd5

ggerganov committed 31 days ago

4cf5cab6

ggml : bump version to 0.19.0 (ggml/1581)

ggerganov committed 31 days ago

933f46f3

server : clarify comment in eval_llama_cmpl_schema [no ci] [no release] (#26720)

danbev committed 31 days ago

Verified 9ba73fd1

webui: load the model selected via ?model= when ?load=true (#26707)

erusev committed 31 days ago

Verified f4f7758c

ui: set npm `min-release-age` to protect against supply-chain attacks (#26711)

nikwen committed 31 days ago

Verified 34e9ee57

server: (router) add LRU scheduler (#26572)

ngxson committed 31 days ago

Verified dff15d4a

server: (router) do not evict busy models (#26567)

ngxson committed 31 days ago

Verified e1470ee6

mtmd: stop feeding the text stream again during Qwen3-TTS generation (#26706)

ServeurpersoCom committed 31 days ago

Verified 217df17a

ggml : add aarch64 HWCAP fallbacks and fix fp16 variant detection (#25554)

kilian-hu committed 31 days ago

Verified cb26014d

ui: read model modalities from the router model list (#26709)

ServeurpersoCom committed 31 days ago

Verified 82bb4850

Mitigate crashing issue on Windows MSYS2 UCRT64 environment (GCC 16.1.0) (#26555)

rillomas committed 31 days ago

Verified 42e98813

sycl: fix UE4M3 parsing (#25608)

clee committed 31 days ago

Verified fc3f10b3

sycl: *glu flat path (#26354)

Titaniumtown committed 31 days ago

Verified 6b5c2efb

sycl : Support DSv4 OPs: LIGHTNING_INDEXER,DSV4_HC_COMB,DSV4_HC_POST,DSV4_HC_PRE (#26568)

arthw committed 31 days ago

Verified 31558dbb

Older