ggml-org/llama.cpp

Pull Requests Commits

Merge branch 'master' into speculative-tree

ggerganov committed 1 year ago

Verified ad2727d0

fix embeddings when using CUDA (#3657)

slaren committed 1 year ago

Verified cb33f43a

llama : avoid fprintf in favor of LLAMA_LOG (#3538)

ggerganov committed 1 year ago

Verified e1675d13

readme : update hot-topics & models, detail windows release in usage (#3615)

BarfingLemurs committed 1 year ago

Verified 8402566a

CLBlast: Fix temporary buffer size for f16 conversion (wsize)

shibe2 committed 1 year ago

40e5ce05

train-text-from-scratch : fix assert failure in ggml-alloc (#3618)

slaren committed 1 year ago

Verified a5e8c1d8

editorconfig : remove trailing spaces

ggerganov committed 1 year ago

Verified e74c705e

server : documentation of JSON return value of /completion endpoint (#3632)

coezbek committed 1 year ago

Verified 3ad1e3f1

Merge branch 'master' into speculative-tree

ggerganov committed 1 year ago

Verified bd9451ca

save-load-state : fix example + add ci test (#3655)

ggerganov committed 1 year ago

Verified 1142013d

readme : add Aquila2 links (#3610)

ftgreat committed 1 year ago

Verified 5fe268a4

tokenizer : special token handling (#3538)

staviq committed 1 year ago

Verified 1a159553

Merge branch 'master' into speculative-tree

ggerganov committed 1 year ago

Verified 010c52ec

speculative : fix the n_drafted fix + p constants

ggerganov committed 1 year ago

Verified e6dd81f0

speculative : fix off-by-one for n_drafted

ggerganov committed 1 year ago

Verified f07cd35d

k-quants : fix quantization ranges (#3646)

ggerganov committed 1 year ago

Verified 281ef73c

llava : fix tokenization to not add bos between image embeddings and user prompt (#3645)

ggerganov committed 1 year ago

Verified 940efa95

minor : comments + rename

ggerganov committed 1 year ago

Verified 373d782d

speculative : minor refactor

ggerganov committed 1 year ago

Verified 1c626e2f

common : add llama_batch_add() and llama_batch_clear() helpers

ggerganov committed 1 year ago

Verified 360a3331

prompts : add assistant.txt

ggerganov committed 1 year ago

Verified 00594910

swift : try to fix build

ggerganov committed 1 year ago

Verified 5b34bfa2

swift : fix build

ggerganov committed 1 year ago

Verified b8acb6c9

sampling : fix malloc

ggerganov committed 1 year ago

Verified b5554b9e

batched : fix n_seq_id

ggerganov committed 1 year ago

Verified 0d96efab

examples : fix build after sampling refactoring

ggerganov committed 1 year ago

Verified 7e48e21b

speculative : refactor sampling

ggerganov committed 1 year ago

Verified 4a7f43f2

speculative : reuse the n_parallel CLI param

ggerganov committed 1 year ago

Verified 32a67cbd

MPT : support GQA for replit-code-v1.5 (#3627)

cebtenzzre committed 1 year ago

Verified 11bff290

speculative : add tree-based sampling support

ggerganov committed 1 year ago

Verified 4de5a2d4

Older