ngxson/llama.cpp

Pull Requests Commits

server : refactor slot input data, move tokenizer to HTTP thread (#10023)

ngxson committed 1 year ago

Verified 958367bf

ci : fix cmake flags for SYCL

ggerganov committed 1 year ago

Verified 40f25557

CUDA: fix insufficient buffer clearing for MMQ (#10032)

JohannesGaessler committed 1 year ago

Verified 167a5156

CUDA: fix MMQ for non-contiguous src0, add tests (#10021)

JohannesGaessler committed 1 year ago

Verified c39665f5

server : samplers accept the prompt correctly (#10019)

wwoodsTM committed 1 year ago

Verified 0a1c750c

ggerganov committed 1 year ago

Verified 190a37d7

llama.vim : bump generation time limit to 3s [no ci]

ggerganov committed 1 year ago

Verified 2d3aba9e

CUDA: fix 1D im2col, add tests (ggml/993)

JohannesGaessler committed 1 year ago

80273a30

ggml : remove redundant set of contexts used field (ggml/978)

danbev committed 1 year ago

c19af0ac

llama.vim : add classic vim support (#9995)

m18coppola committed 1 year ago

Verified ac113a0f

metal : add POOL2D and fix IM2COL (#9943)

junhee-yoo committed 1 year ago

Verified 4c9388fb

flake.lock: Update

github-actions[bot] committed 1 year ago

873279b1

llama : fix empty batch causing llama_batch_allocr to crash (#9966)

ngxson committed 1 year ago

Verified c8c07d65

llama : rename batch to ubatch (#9950)

danbev committed 1 year ago

Verified 19d900a7

Rwkv chat template fix (#10001)

MollySophia committed 1 year ago

Verified 11d47057

lora : warn user if new token is added in the adapter (#9948)

ngxson committed 1 year ago

Verified c421ac07

llama : add chat template for RWKV-World + fix EOT (#9968)

MollySophia committed 1 year ago

Verified 4ff7fe1f

[CANN] Adapt to dynamically loadable backends mechanism (#9970)

leo-pony committed 1 year ago

Verified 6b844735

arg : fix typo in embeddings argument help [no ci] (#9994)

danbev committed 1 year ago

Verified 674804a9

llama.vim : fix info text display [no ci] (#9787)

ggerganov committed 1 year ago

Verified e94a138d

llama.vim : move info to the right of screen [no ci] (#9787)

ggerganov committed 1 year ago

Verified e01c67af

readme : update UI list (#9972)

a-ghorbani committed 1 year ago

Verified 994cfb1a

arg : fix attention non-causal arg value hint (#9985)

danbev committed 1 year ago

Verified 94008cc7

llama.vim : plugin for Neovim (#9787)

ggerganov committed 1 year ago

Verified dbd5f2f5

ggml : add asserts for type conversion in fattn kernels (#9971)

ggerganov committed 1 year ago

Verified f594bc80

rpc : pack only RPC structs (#9959)

rgerganov committed 1 year ago

Verified d5ebd79c

llama : default sampling changes + greedy update (#9897)

ggerganov committed 1 year ago

Verified 55e47786

speculative : fix handling of some input params (#9963)

ggerganov committed 1 year ago

Verified bc219750

fix mul_mat_vec_q and *_vec_q error (#9939)

NeoZhangJianyu committed 1 year ago

Verified 1db8c84f

readme : update bindings list (#9951)

lcarrere committed 1 year ago

Verified 45f09764

Newer Older