ngxson/llama.cpp

Pull Requests Commits

allowing using both n_cmpl and n

ngxson committed 10 days ago

ea7f0669

add n_cmpl to docs [no ci]

ngxson committed 11 days ago

6fb3226d

ngxson committed 11 days ago

b65ee647

update comments

ngxson committed 11 days ago

46f6fd26

ngxson committed 11 days ago

e0660710

disable ctx shift

ngxson committed 11 days ago

2a7728f5

ngxson committed 11 days ago

5cc3156f

ngxson committed 12 days ago

a768a5e8

fix invalid batch

ngxson committed 12 days ago

bf33d13b

server: support multiple generations from one prompt (OAI "n" option)

ngxson committed 12 days ago

0d842cb5

backend support

ngxson committed 12 days ago

15ce574d

Add support for CUMSUM and TRI for CUDA. (#17584)

pwilkin committed 12 days ago

Verified 96fe9bad

metal: TRI, FILL, EXPM1, SOFTPLUS (#16623)

gabe-l-hart committed 12 days ago

Verified bde188d6

server: strip content-length header on proxy (#17734)

ngxson committed 12 days ago

Verified 9d022996

server: move msg diffs tracking to HTTP thread (#17740)

ngxson committed 12 days ago

Verified c4c10bfb

examples : add missing code block end marker [no ci] (#17756)

danbev committed 12 days ago

Verified 817d743c

common : skip model validation when --help is requested (#17755)

danbev committed 12 days ago

Verified bd4ef134

ggml-cpu : remove asserts always evaluating to false (#17728)

Alcpz committed 12 days ago

Verified 87a2084c

convert: use existing local chat_template if mistral-format model has one. (#17749)

SmartestWashingMachine committed 12 days ago

Verified 3659aa28

cmake : simplify build info detection using standard variables (#17423)

angt committed 12 days ago

Verified 2a73f81f

ci : disable ggml-ci-x64-amd-* (#17753)

CISC committed 12 days ago

Verified 7dba049b

common: use native MultiByteToWideChar (#17738)

angt committed 13 days ago

Verified 83c11715

metal : use params per pipeline instance (#17739)

ggerganov committed 13 days ago

Verified 0d132485

llama : fix sanity checks during quantization (#17721)

ggerganov committed 13 days ago

Verified a67ef0f4

build : move _WIN32_WINNT definition to headers (#17736)

angt committed 13 days ago

Verified ef75a89f

build: enable parallel builds in msbuild using MTT (#17708)

jeffbolznv committed 13 days ago

Verified d8b5cdc4

ggml-cpu: remove duplicate conditional check 'iid' (#17650)

GermanAizek committed 13 days ago

Verified dea9ba27

Add a couple of file types to the text section (#17670)

pwilkin committed 13 days ago

Verified c6d1a00a

convert : support latest mistral-common (fix conversion with --mistral-format) (#17712)

SmartestWashingMachine committed 13 days ago

Verified 424c5794

Use OpenAI-compatible `/v1/models` endpoint by default (#17689)

allozaur committed 13 days ago

Verified e9f94834

Older