ngxson/llama.cpp

Pull Requests Commits

correct buffer size

ngxson committed 2 years ago

476d319f

add enum keyword

ngxson committed 2 years ago

7f898035

llama_chat_get_typed_template

ngxson committed 2 years ago

0d3363e4

adapt phi3 template

ngxson committed 2 years ago

81b59038

Merge branch 'master' into xsn/chat_template_prefix_postfix

ngxson committed 2 years ago

ada54292

add guide for adding template

ngxson committed 2 years ago

3222b4b8

ngxson committed 2 years ago

f1a93548

fix templates not support system message

ngxson committed 2 years ago

588b72d9

llama : add llama_get_pooling_type function (#6862)

iamlemec committed 2 years ago

Verified b4e4b8a9

server : do not apply Markdown formatting in code sections (#6850)

mgroeber9110 committed 2 years ago

Verified 3fe847b5

common : revert showing control tokens by default for server (#6860)

K-Mistele committed 2 years ago

Verified 37246b10

Server: fix seed for multiple slots (#6835)

JohannesGaessler committed 2 years ago

Verified 28103f48

ggml : move 32-bit arm compat in ggml-impl.h (#6865)

ggerganov committed 2 years ago

Verified c0d1b3e0

llama : add phi 3 chat template (#6857)

tristandruyen committed 2 years ago

Verified abd33140

convert : add support of codeqwen due to tokenizer (#6707)

JustinLin610 committed 2 years ago

Verified 3fec68be

llama : add phi3 support (#6852)

liuwei-git committed 2 years ago

Verified c8297c6a

[SYCL] Windows default build instructions without -DLLAMA_SYCL_F16 flag activated (#6767)

aahouzi committed 2 years ago

Verified 4e96a812

llamafile : improve sgemm.cpp (#6796)

jart committed 2 years ago

Verified 192090ba

ggml : fix calloc argument ordering. (#6820)

airlied committed 2 years ago

Verified e931888d

llama : fix typo in <|im_end|> token text (#6745)

ggerganov committed 2 years ago

Verified 8960fe86

ci: fix job are cancelling each other (#6781)

phymbert committed 2 years ago

Verified c0956b09

flake.lock: Update

github-actions[bot] committed 2 years ago

e9b4a1bf

ngxson committed 2 years ago

a202b561

fix llama_chat_apply_template

ngxson committed 2 years ago

98c46cfb

refactor chat template api

ngxson committed 2 years ago

d6df8ecb

`build`: generate hex dump of server assets during build (#6661)

ochafik committed 2 years ago

Verified 5cf5e7d4

llama : add option to render special/control tokens (#6807)

ggerganov committed 2 years ago

Verified 40f74e4d

ggml : fix ggml_backend_cpu_supports_op() for CPY (#0)

ggerganov committed 2 years ago

Verified b9cc76d8

llama : add llama-3 chat template (#6751)

DifferentialityDevelopment committed 2 years ago

Verified 7dbdba56

gguf-py : add IQ1_M to GGML_QUANT_SIZES (#6761)

piotrek1996 committed 2 years ago

Verified c1386c93

Older