ochafik/llama.cpp

Pull Requests Commits

json: rm useless assert & ggml.h import

Olivier Chafik committed 1 year ago

dfd4eb3a

json: rm dead code

ochafik committed 1 year ago

ba90d5b7

json: remove recursion in opt_repetitions (avoids Python stack overflow)

ochafik committed 1 year ago

64e30590

Merge remote-tracking branch 'origin/master' into json-faster-repetitions2

ochafik committed 1 year ago

958bdda5

ci : disable Metal for macOS-latest-cmake-x64 (#6628)

ggerganov committed 1 year ago

Verified 9ed2737a

Optimization: eliminate addition of redundant stacks when advancing grammar. (#6616)

HanClinto committed 2 years ago

Verified 04a5ac21

json: simplify DOT `{"type": "string", "pattern": "^.$"}`

ochafik committed 2 years ago

ed13d47c

As suggested by @slaren, disabling Metal for test to fix CI build on OSX from #6576 (#6619)

HanClinto committed 2 years ago

Verified f7001ccc

Refactor Error Handling for CUDA (#6575)

nneubacher committed 2 years ago

Verified a474f50e

grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609)

ochafik committed 2 years ago

Verified cbaadc92

ci: download artifacts to release directory (#6612)

Hugi-R committed 2 years ago

Verified 1bbdaf6e

scripts : add --outdir option to hf.sh (#6600)

danbev committed 2 years ago

Verified f4183afe

eval-callback: Example how to use eval callback for debugging (#6576)

phymbert committed 2 years ago

Verified b804b1ef

gguf : add option to not check tensor data (#6582)

danbev committed 2 years ago

Verified 8228b66d

minor layout improvements (#6572)

rsoika committed 2 years ago

Verified b3a96f27

llama : add model types for mixtral (#6589)

slaren committed 2 years ago

Verified 4f407a0a

convert.py : add consolidated.safetensors for mixtral 8x22b (#6587)

slaren committed 2 years ago

Verified 65c64dc3

docs : how to add a model (#6565)

phymbert committed 2 years ago

Verified 67fac4b9

readme : fix ROCm link (#6579)

artem-zinnatullin committed 2 years ago

Verified 29122d32

readme : update UI list (#6560)

ylsdamxssjxxdd committed 2 years ago

Verified b231b37b

readme: fix typo in amdgpu target name (#6573)

Sejsel committed 2 years ago

Verified ba5e134e

BERT tokenizer fixes (#6498)

cebtenzzre committed 2 years ago

Verified 1b67731e

ggerganov committed 2 years ago

Verified c4a3a4ff

json: fix server/README (json_schema in /completion vs. result_format in /v1/chat/completions)

Olivier Chafik committed 2 years ago

9c33ee99

server : detect search query to start webchat (#6554)

Mardak committed 2 years ago

Verified 400d5d72

llama : add Command R Plus support (#6491)

RefractAI committed 2 years ago

Verified 5dc9dd71

license : update copyright notice + add AUTHORS (#6405)

ggerganov committed 2 years ago

Verified e11a8999

json: fix type error w/ python 3.8

ochafik committed 2 years ago

67a5184f

ochafik committed 2 years ago

3c81e944

server+json: update server/README w/ result_format

ochafik committed 2 years ago

6c885dce

Older