ochafik/llama.cpp

Pull Requests Commits

grammar: speedup sampling setup!!

ochafik committed 2 years ago

93f4a575

grammar: early exit if there are no next candidates!

ochafik committed 2 years ago

a8ee3f19

Update llama.cpp

ochafik committed 2 years ago

8c45493e

grammars: back to stacks array

ochafik committed 2 years ago

71dab39a

grammar: more callbacks

ochafik committed 2 years ago

2e0f50c9

Update llama.cpp

ochafik committed 2 years ago

7f77db74

grammars :cheap head sets

ochafik committed 2 years ago

5beb5a21

grammars: hashsets for stacks

ochafik committed 2 years ago

ff2ac162

grammar-stacks-callbacks

ochafik committed 2 years ago

d74d0f65

ci: add ubuntu latest release and fix missing build number (mac & ubuntu) (#6748)

loonerin committed 2 years ago

Verified 0e4802b2

server: static: upstream upgrade (#6765)

phymbert committed 2 years ago

Verified 637e9a86

Implement the OLMo architecture (#6741)

nopperl committed 2 years ago

Verified 9958c81b

train : add general name (#6752)

teleprint-me committed 2 years ago

Verified 8b1b1f49

fix wrong parameter in cmd in readme-sycl.md (#6755)

arthw committed 2 years ago

Verified bca40e98

ggml : group all experts in a single ggml_mul_mat_id (#6505)

slaren committed 2 years ago

Verified 0d56246f

convert : support models with multiple chat templates (#6588)

CISC committed 2 years ago

Verified 03c0946d

Qwen2 : assume tied weights if lm_head/output weights is missing (#6738)

jklj077 committed 2 years ago

Verified e11b2e6e

llama : fix compatibility with old 2 expert models (#6735)

slaren committed 2 years ago

Verified c71bfd73

llamafile : tmp disable + build sgemm.o when needed (#6716)

ggerganov committed 2 years ago

Verified 3b8f1ec4

readme : add UI (#6724)

yaroslavyaroslav committed 2 years ago

Verified 8dd1ec8b

convert : fix autoawq gemma (#6704)

dengzheng-cloud committed 2 years ago

Verified facb8b56

llama : make general.name optional (#6709)

ggerganov committed 2 years ago

Verified 532c1737

ggml : fix llamafile sgemm wdata offsets (#6710)

ggerganov committed 2 years ago

Verified 666867b7

ggml : add llamafile sgemm (#6414)

jart committed 2 years ago

Verified 8cc91dc6

llama : add StableLM2 12B (#6635)

ashishdatta committed 2 years ago

Verified dbceec87

llama : add qwen2moe (#6074)

simonJJJ committed 2 years ago

Verified f4dea7da

gritlm : add --outdir option to hf.sh script (#6699)

danbev committed 2 years ago

Verified 8a56075b

perplexity : require positive --ctx-size arg (#6695)

ggerganov committed 2 years ago

Verified 58227ffd

gguf : add special tokens metadata for FIM/Infill (#6689)

danbev committed 2 years ago

Verified 4fbd8098

`main`: add --json-schema / -j flag (#6659)

ochafik committed 2 years ago

Verified 7593639c

Older