ochafik/llama.cpp

Pull Requests Commits

`llama-cli`: Support reading the prompt from stdin w/ -f -

ochafik committed 1 year ago

a3fe19e1

flake.lock: Update (#9068)

ggerganov committed 1 year ago

Verified 554b0490

tests : add integration test for lora adapters (#8957)

ltoniazzi committed 1 year ago

Verified 2339a0be

Fix incorrect use of ctx_split for bias tensors (#9063)

suhara committed 1 year ago

Verified 2fb92678

server : refactor middleware and /health endpoint (#9056)

ngxson committed 1 year ago

Verified 8b3befc0

llava : support MiniCPM-V-2.6 (#8967)

tc-mb committed 1 year ago

Verified d565bb2f

py : fix wrong input type for raw_dtype in ggml to gguf scripts (#8928)

farbodbj committed 1 year ago

Verified ee2984bd

Fix inference example lacks required parameters (#9035)

Aisuko committed 1 year ago

Verified c8ddce85

gguf-py : bump version from 0.9.1 to 0.10.0 (#9051)

compilade committed 1 year ago

Verified 23fd4535

llama : add EXAONE model support (#9025)

mscheong01 committed 1 year ago

Verified c679e0cb

common : add support for cpu_get_num_physical_cores() on Windows (#8771)

Septa2112 committed 1 year ago

Verified fb487bb5

Add Nemotron/Minitron GGUF Conversion & Inference Support (#8922)

suhara committed 1 year ago

Verified 2a24c8ca

ggml : dynamic ggml_sched_max_splits based on graph_size (#9047)

nicoboss committed 1 year ago

Verified e3f6fd56

retrieval : fix memory leak in retrieval query handling (#8955)

gtygo committed 1 year ago

Verified 4b9afbbe

server : fix duplicated n_predict key in the generation_settings (#8994)

snowyu committed 1 year ago

Verified 37501d9c

common : remove duplicate function llama_should_add_bos_token (#8778)

kylo5aby committed 1 year ago

Verified 4af8420a

llama : add pre-tokenizer regexes for BLOOM and gpt3-finnish (#8850)

Exploder98 committed 1 year ago

Verified 6bda7ce6

ci : disable bench workflow (#9010)

ggerganov committed 1 year ago

Verified d5492f05

server : init stop and error fields of the result struct (#9026)

jpodivin committed 1 year ago

Verified 234b3067

Vulkan Optimizations and Fixes (#8959)

0cc4m committed 1 year ago

Verified 5fd89a70

server : fix segfault on long system prompt (#8987)

compilade committed 1 year ago

Verified 98a532d4

cmake : remove unused option GGML_CURL (#9011)

ggerganov committed 1 year ago

Verified 43bdd3ce

ggml : move rope type enum to ggml.h (#8949)

danbev committed 1 year ago

Verified 06943a69

export-lora : throw error if lora is quantized (#9002)

ngxson committed 1 year ago

Verified 828d6ff7

ci : fix github workflow vulnerable to script injection (#9008)

diogoteles08 committed 1 year ago

Verified fc4ca27b

ci : enable RPC in all of the released builds (#9006)

rgerganov committed 1 year ago

Verified 1f67436c

llama : model-based max number of graph nodes calculation (#8970)

nicoboss committed 1 year ago

Verified 0fd93cde

docs: introduce gpustack and gguf-parser (#8873)

thxCode committed 1 year ago

Verified 84eb2f4f

grammar-parser : fix possible null-deref (#9004)

DavidKorczynski committed 1 year ago

Verified 1262e7ed

ggml: fix div-by-zero (#9003)

DavidKorczynski committed 1 year ago

Verified df5478fb

Older