ochafik/llama.cpp

Pull Requests Commits

llama : keep track of all EOG tokens in the vocab (#9609)

ggerganov committed 1 year ago

Verified 31ac5834

log : add CONT level for continuing previous log entry (#9610)

ggerganov committed 1 year ago

Verified cea1486e

server : add newline after chat example (#9616)

StrangeBytesDev committed 1 year ago

Verified 0aa15011

sampling : avoid expensive softmax during greedy sampling (#9605)

ggerganov committed 1 year ago

Verified b0f27361

threads: fix msvc build without openmp (#9615)

max-krasnyansky committed 1 year ago

Verified c087b6f1

cuda: add q8_0->f32 cpy operation (#9571)

Nekotekina committed 1 year ago

Verified 116efee0

server : add --no-context-shift option (#9607)

ngxson committed 1 year ago

Verified 0b3bf966

threads: improve ggml_barrier scaling with large number of threads (#9598)

max-krasnyansky committed 1 year ago

Verified f0c7b5ed

readme : add programmable prompt engine language CLI (#9599)

snowyu committed 1 year ago

Verified 1d48e98e

Update json-schema-to-grammar.cpp

ochafik committed 1 year ago

071f2a7b

json: make SchemaConverter.add_rule public

ochafik committed 1 year ago

a50a24c3

flake.lock: Update (#9586)

ggerganov committed 1 year ago

Verified f3979df7

ggml : AVX512 gemm for Q4_0_8_8 (#9532)

Srihari-mcw committed 1 year ago

Verified 1e7b9299

perplexity : remove extra new lines after chunks (#9596)

ggerganov committed 1 year ago

Verified 37f8c7b4

metal : use F32 prec for K*Q in vec FA (#9595)

ggerganov committed 1 year ago

Verified bf9c1013

Revert "[SYCL] fallback mmvq (#9088)" (#9579)

Akarshan Biswas committed 1 year ago

Verified e62e9789

update jinja test cases

ochafik committed 1 year ago

22b33768

jinja: support selectattr, last, map, length on str

ochafik committed 1 year ago

31139bbc

ochafik committed 1 year ago

fb179627

musa: enable building fat binaries, enable unified memory, and disable Flash Attention on QY1 (MTT S80) (#9526)

yeahdongcn committed 1 year ago

Verified c35e586e

jinja: implement str.strip()

ochafik committed 1 year ago

80cf8a76

jinja: pass context as shared ptr

ochafik committed 1 year ago

b85e7b60

Update utils.hpp

ochafik committed 1 year ago

10b15906

jinja: fix precedence of not vs. is operators

ochafik committed 1 year ago

eea07c57

Update utils.hpp

ochafik committed 1 year ago

5a7e55bd

wire jinja through normal message paths

ochafik committed 1 year ago

bfd81c78

Fix merge error in #9454 (#9589)

MollySophia committed 1 year ago

Verified 912c331d

CUDA: enable Gemma FA for HIP/Pascal (#9581)

JohannesGaessler committed 1 year ago

Verified a5b57b08

llama: remove redundant loop when constructing ubatch (#9574)

shankarg87 committed 1 year ago

Verified ecd5d6b6

RWKV v6: RWKV_WKV op CUDA implementation (#9454)

MollySophia committed 1 year ago

Verified 2a63caaa

Newer Older