ngxson/llama.cpp

Pull Requests Commits

use llama_tokens everywhere

ngxson committed 1 year ago

7f7acdbe

ngxson committed 1 year ago

13ee7793

rename completion to inference

ngxson committed 1 year ago

4a9f3e76

remove redundant code

ngxson committed 1 year ago

575b1332

ngxson committed 1 year ago

c34ab08a

try fixing format_infill

ngxson committed 1 year ago

07381f7d

add infill test

ngxson committed 1 year ago

fea5ca45

bring back infill validation

ngxson committed 1 year ago

cff97ad3

fix infinite generation loop

ngxson committed 1 year ago

b550011b

fix incorrect if branch

ngxson committed 1 year ago

60d4194b

Merge branch 'master' into xsn/refactor_server_slot_input

ngxson committed 1 year ago

3abc3396

move prompt_tokens.empty() check

ngxson committed 1 year ago

5c749bea

server : refactor slot input data, move tokenizer to HTTP thread

ngxson committed 1 year ago

125835b2

server : samplers accept the prompt correctly (#10019)

wwoodsTM committed 1 year ago

Verified 0a1c750c

ggerganov committed 1 year ago

Verified 190a37d7

llama.vim : bump generation time limit to 3s [no ci]

ggerganov committed 1 year ago

Verified 2d3aba9e

CUDA: fix 1D im2col, add tests (ggml/993)

JohannesGaessler committed 1 year ago

80273a30

ggml : remove redundant set of contexts used field (ggml/978)

danbev committed 1 year ago

c19af0ac

llama.vim : add classic vim support (#9995)

m18coppola committed 1 year ago

Verified ac113a0f

metal : add POOL2D and fix IM2COL (#9943)

junhee-yoo committed 1 year ago

Verified 4c9388fb

flake.lock: Update

github-actions[bot] committed 1 year ago

873279b1

llama : fix empty batch causing llama_batch_allocr to crash (#9966)

ngxson committed 1 year ago

Verified c8c07d65

llama : rename batch to ubatch (#9950)

danbev committed 1 year ago

Verified 19d900a7

Rwkv chat template fix (#10001)

MollySophia committed 1 year ago

Verified 11d47057

lora : warn user if new token is added in the adapter (#9948)

ngxson committed 1 year ago

Verified c421ac07

llama : add chat template for RWKV-World + fix EOT (#9968)

MollySophia committed 1 year ago

Verified 4ff7fe1f

[CANN] Adapt to dynamically loadable backends mechanism (#9970)

leo-pony committed 1 year ago

Verified 6b844735

arg : fix typo in embeddings argument help [no ci] (#9994)

danbev committed 1 year ago

Verified 674804a9

llama.vim : fix info text display [no ci] (#9787)

ggerganov committed 1 year ago

Verified e94a138d

llama.vim : move info to the right of screen [no ci] (#9787)

ggerganov committed 1 year ago

Verified e01c67af

Older