ngxson/llama.cpp

Pull Requests Commits

model: add llama 4 scaling for mistral-large (deepseek arch)

ngxson committed 41 days ago

49d2305e

CUDA: generalized (mma) FA, add Volta support (#17505)

JohannesGaessler committed 41 days ago

Verified 2e1c9cd8

chat : reserve memory in compute_diffs and improve naming (#17729)

ggerganov committed 41 days ago

Verified 190c4838

server: add router multi-model tests (#17704) (#17722)

ServeurpersoCom committed 42 days ago

Verified e7c2cf13

server : fix bad fmt, size() is a size_type (#17735)

angt committed 42 days ago

Verified 12574910

cmake: explicitly link against crypt32 on non-MSVC Windows builds (#17727)

angt committed 42 days ago

Verified 083e18b1

metal : fix data race in pipeline library (#17731)

ggerganov committed 42 days ago

Verified 3d94e967

ci : remove the build of openeuler-cann in release (#17724)

xuedinge233 committed 42 days ago

Verified 7feb0a10

common : introduce composable PEG parser combinators for chat parsing (#17136)

aldehir committed 42 days ago

Verified 0a8026e7

server: fix duplicate HTTP headers in multiple models mode (#17698)

ServeurpersoCom committed 42 days ago

Verified 5ceed624

ggml webgpu: add support for emscripten builds (#17184)

reeselevine committed 42 days ago

Verified 7ca5991d

ci : move release details to the top visible by default (#17719)

CISC committed 42 days ago

Verified b3e3060f

ggml, llama : use defaulted constructors/destructors (#17649)

GermanAizek committed 42 days ago

Verified 37adc9c6

build: document how to compile with Vulkan using Debian/Ubuntu packages (#17688)

socram8888 committed 42 days ago

Verified 16cc3c60

server: add --media-path for local media files (#17697)

ngxson committed 42 days ago

Verified 13628d8b

mtmd: fix --no-warmup (#17695)

ngxson committed 42 days ago

Verified a96283ad

ci : RVV1.0 builds with tests (#16682)

alitariq4589 committed 42 days ago

Verified 4eba8d94

vulkan: Reduce temporary memory usage for TOP_K (#17623)

jeffbolznv committed 42 days ago

Verified 61bde8e2

cmake : add utf8 compilation options for msvc (#17682)

xiaobing318 committed 42 days ago

Verified e251e5eb

Server: Change Invalid Schema from Server Error (500) to User Error (400) (#17572)

chadvoegele committed 42 days ago

Verified c4357dcc

ggml : use svcntb() for SVE vector length detection (#17474)

angt committed 42 days ago

Verified e148380c

CANN: Disable Ger operator of OUT_PROD on 310p device (#17563)

TianHao324 committed 43 days ago

Verified a2b0fe8d

ggml : remove redundant n_copies check when setting input/output (#17612)

danbev committed 43 days ago

Verified 7f3a72a8

codeowners : remove ericcurtin (#17658)

ericcurtin committed 43 days ago

Verified b9a37717

llama : fix signed comparison warning on FreeBSD (#17497)

angt committed 43 days ago

Verified f3a9674a

convert: add error message for mistral3 quantized weight (#17686)

ngxson committed 43 days ago

Verified 2c453c6c

server: remove default "gpt-3.5-turbo" model name (#17668)

ngxson committed 43 days ago

Verified 5d6bd842

server: fixing naming conflict res_error in server-models.cpp (#17679)

w169q169 committed 43 days ago

Verified fd3abe84

server: explicitly set exec path when create new instance (#17669)

ngxson committed 43 days ago

Verified 682e6658

ci : skip winget update when not in ggml-org (#17465)

angt committed 43 days ago

Verified 4574f294

Older