ggerganov/llama.cpp

Pull Requests Commits

straightforward /v1/models endpoint

Tobi Lütke committed 1 year ago

21b70bab

server : change random string generator

ggerganov committed 1 year ago

Verified b6163142

server : minor code style

ggerganov committed 1 year ago

Verified b3e88bf4

server : enable special tokens during tokenization by default

ggerganov committed 1 year ago

Verified c544faed

server : indentation

ggerganov committed 1 year ago

Verified b94b1091

Merge branch 'master' into server-oai-compat

ggerganov committed 1 year ago

Verified 80724eb0

server : some style changes

ggerganov committed 1 year ago

Verified f25308be

readme : use PATH for Windows ROCm (#4195)

jammm committed 1 year ago

Verified b35f3d0d

Fix incorrect format strings and uninitialized variables. (#4133)

haohui committed 1 year ago

Verified 55978ce0

llama : KV cache view API + better KV cache management (#4170)

ggerganov committed 1 year ago

Verified 6b0a7420

readme : update hot topics

ggerganov committed 1 year ago

Verified d103d935

examples : fix typo in parallel example doc comment (#4181)

danbev committed 1 year ago

Verified 9d5949f0

docs : add llama-star arch idea

ggerganov committed 1 year ago

Verified ff8238f7

Fix server.cpp code style according to review

kir-gadjello committed 1 year ago

Verified e1516709

Improve server README.md

kir-gadjello committed 1 year ago

Verified 9ad4d273

Update server README.md

kir-gadjello committed 1 year ago

Verified af4d68b2

kir-gadjello committed 1 year ago

Verified 2f84f5dc

Add openai-compatible POST /v1/chat/completions API endpoint to server example

kir-gadjello committed 1 year ago

Verified a0a08eed

stablelm : simplify + speedup generation (#4153)

Galunid committed 1 year ago

Verified 8e672efe

finetune - update readme to mention llama support only (#4148)

Galunid committed 1 year ago

Verified 0b871f1a

readme : update ROCm Windows instructions (#4122)

jammm committed 1 year ago

Verified dfc7cd48

main : Add ChatML functionality to main example (#4046)

Sebby37 committed 1 year ago

Verified 881800d1

ci : add flake8 to github actions (python linting) (#4129)

Galunid committed 1 year ago

Verified f23c0359

speculative : fix prompt tokenization in speculative example (#4025)

AutonomicPerfectionist committed 1 year ago

Verified 40a34fe8

Revert "finetune : add --n-gpu-layers flag info to --help (#4128)"

ggerganov committed 1 year ago

Verified dae06c06

finetune : add --n-gpu-layers flag info to --help (#4128)

csaben committed 1 year ago

Verified 05e8301e

server : relay error messages (#4131)

SoftwareRenderer committed 1 year ago

Verified 936c79b2

common : comma should be semicolon (#4137)

kchro3 committed 1 year ago

Verified 262005ad

gitignore : tokenize

ggerganov committed 1 year ago

Verified 35985acf

gguf-py : export chat templates (#4125)

slaren committed 1 year ago

Verified e9370664

Older