ggml-org/llama.cpp

Pull Requests Commits

imatrix : remove invalid assert

ggerganov committed 1 year ago

Verified 8b495540

Correct free memory and total memory. (#6630)

MasterYi1024 committed 1 year ago

Verified dee7f8d6

eval-callback: use ggml_op_desc to pretty print unary operator name (#6631)

phymbert committed 1 year ago

Verified 81da18e7

ci : disable Metal for macOS-latest-cmake-x64 (#6628)

ggerganov committed 1 year ago

Verified 9ed2737a

Optimization: eliminate addition of redundant stacks when advancing grammar. (#6616)

HanClinto committed 1 year ago

Verified 04a5ac21

As suggested by @slaren, disabling Metal for test to fix CI build on OSX from #6576 (#6619)

HanClinto committed 1 year ago

Verified f7001ccc

Refactor Error Handling for CUDA (#6575)

nneubacher committed 1 year ago

Verified a474f50e

grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609)

ochafik committed 1 year ago

Verified cbaadc92

ci: download artifacts to release directory (#6612)

Hugi-R committed 1 year ago

Verified 1bbdaf6e

scripts : add --outdir option to hf.sh (#6600)

danbev committed 1 year ago

Verified f4183afe

eval-callback: Example how to use eval callback for debugging (#6576)

phymbert committed 1 year ago

Verified b804b1ef

gguf : add option to not check tensor data (#6582)

danbev committed 1 year ago

Verified 8228b66d

minor layout improvements (#6572)

rsoika committed 1 year ago

Verified b3a96f27

llama : add model types for mixtral (#6589)

slaren committed 1 year ago

Verified 4f407a0a

convert.py : add consolidated.safetensors for mixtral 8x22b (#6587)

slaren committed 1 year ago

Verified 65c64dc3

docs : how to add a model (#6565)

phymbert committed 1 year ago

Verified 67fac4b9

readme : fix ROCm link (#6579)

artem-zinnatullin committed 1 year ago

Verified 29122d32

readme : update UI list (#6560)

ylsdamxssjxxdd committed 1 year ago

Verified b231b37b

readme: fix typo in amdgpu target name (#6573)

Sejsel committed 1 year ago

Verified ba5e134e

BERT tokenizer fixes (#6498)

cebtenzzre committed 1 year ago

Verified 1b67731e

ggerganov committed 1 year ago

Verified c4a3a4ff

server : detect search query to start webchat (#6554)

Mardak committed 1 year ago

Verified 400d5d72

llama : add Command R Plus support (#6491)

RefractAI committed 1 year ago

Verified 5dc9dd71

license : update copyright notice + add AUTHORS (#6405)

ggerganov committed 1 year ago

Verified e11a8999

llama : fix attention layer count sanity check (#6550)

ggerganov committed 1 year ago

Verified cc4a9542

Comment explaining a decision (#6531)

kunnis committed 1 year ago

Verified cecd8d3c

quantize : fix precedence of cli args (#6541)

ggerganov committed 1 year ago

Verified b73e564b

llama : support negative ith in llama_get_ API (#6519)

TheFlipbook committed 1 year ago

Verified e3c337d8

llama : save and restore kv cache for single seq id (#6341)

kaetemi committed 1 year ago

Verified beea6e1b

remove row=1 cond (#6532)

abhilash1910 committed 1 year ago

Verified 87fb5b42

Older