ngxson/llama.cpp

Pull Requests Commits

update server docs

ngxson committed 2 years ago

a4b63194

ngxson committed 2 years ago

ab3d8ec4

fix server tests

ngxson committed 2 years ago

57d35897

Update examples/server/server.cpp

ngxson committed 2 years ago

Verified a53a59c8

move "fail_on_no_slot" to /slots

ngxson committed 2 years ago

4af74d81

server : refactor middleware and /health endpoint

ngxson committed 2 years ago

b337a7bf

retrieval : fix memory leak in retrieval query handling (#8955)

gtygo committed 2 years ago

Verified 4b9afbbe

server : fix duplicated n_predict key in the generation_settings (#8994)

snowyu committed 2 years ago

Verified 37501d9c

common : remove duplicate function llama_should_add_bos_token (#8778)

kylo5aby committed 2 years ago

Verified 4af8420a

llama : add pre-tokenizer regexes for BLOOM and gpt3-finnish (#8850)

Exploder98 committed 2 years ago

Verified 6bda7ce6

ci : disable bench workflow (#9010)

ggerganov committed 2 years ago

Verified d5492f05

server : init stop and error fields of the result struct (#9026)

jpodivin committed 2 years ago

Verified 234b3067

Vulkan Optimizations and Fixes (#8959)

0cc4m committed 2 years ago

Verified 5fd89a70

server : fix segfault on long system prompt (#8987)

compilade committed 2 years ago

Verified 98a532d4

cmake : remove unused option GGML_CURL (#9011)

ggerganov committed 2 years ago

Verified 43bdd3ce

ggml : move rope type enum to ggml.h (#8949)

danbev committed 2 years ago

Verified 06943a69

export-lora : throw error if lora is quantized (#9002)

ngxson committed 2 years ago

Verified 828d6ff7

ci : fix github workflow vulnerable to script injection (#9008)

diogoteles08 committed 2 years ago

Verified fc4ca27b

ci : enable RPC in all of the released builds (#9006)

rgerganov committed 2 years ago

Verified 1f67436c

llama : model-based max number of graph nodes calculation (#8970)

nicoboss committed 2 years ago

Verified 0fd93cde

docs: introduce gpustack and gguf-parser (#8873)

thxCode committed 2 years ago

Verified 84eb2f4f

grammar-parser : fix possible null-deref (#9004)

DavidKorczynski committed 2 years ago

Verified 1262e7ed

ggml: fix div-by-zero (#9003)

DavidKorczynski committed 2 years ago

Verified df5478fb

Fix a spelling mistake (#9001)

Septa2112 committed 2 years ago

Verified 2589292c

py : fix requirements check '==' -> '~=' (#8982)

ggerganov committed 2 years ago

Verified d3ae0ee8

server : handle models with missing EOS token (#8997)

ggerganov committed 2 years ago

Verified 5ef07e25

gguf-py : Numpy dequantization for most types (#8939)

compilade committed 2 years ago

Verified 4134999e

flake.lock: Update (#8979)

ggerganov committed 2 years ago

Verified 8cd1bcfd

update guide (#8909)

arthw committed 2 years ago

Verified a21c6fd4

llama : check all graph nodes when searching for result_embd_pooled (#8956)

fairydreaming committed 2 years ago

Verified 33309f66

Older