ggerganov/llama.cpp

Pull Requests Commits

use javascript generators as much cleaner API

tobi committed 2 years ago

Verified ff6e39f1

export llama_timings as struct and expose them in server

tobi committed 2 years ago

Verified efa86bf2

basic response formatting

tobi committed 2 years ago

Verified c19daa4e

fix mobile, fix missing prompt cache

tobi committed 2 years ago

Verified eee6d69e

rework state management into session, expose historyTemplate to settings

tobi committed 2 years ago

Verified fedce007

slightly nicer css

tobi committed 2 years ago

Verified 98e612ce

add /completion.js file to make it easy to use the server from js

tobi committed 2 years ago

Verified dd1df3f3

enable server in Makefiles

tobi committed 2 years ago

Verified 8e1b04d3

let's try this with the xxd tool instead and see if msvc is happier with that

tobi committed 2 years ago

Verified dc7dd088

remove need for @microsoft/fetch-event-source dep (-7kb)

tobi committed 2 years ago

Verified 34fc3c7e

revert log format changes

tobi committed 2 years ago

Verified e192f950

tobi committed 2 years ago

Verified 0f95689c

allow server to multithread

tobi committed 2 years ago

Verified 7a389564

switched to fprintf logging and to access_log

tobi committed 2 years ago

Verified a30d4b2a

tobi committed 2 years ago

Verified c8cedf56

embed index and add --path for choosing static dir

tobi committed 2 years ago

Verified 022bf2bb

minor aesthetic fixes

tobi committed 2 years ago

Verified e3fba85d

server : clear trailing whitespace

ggerganov committed 2 years ago

Verified c1cb0e1d

tobi committed 2 years ago

Verified b07b2713

expose simple web interface on root domain

tobi committed 2 years ago

Verified 627d3ba8

Allow old Make to build server. (#2098)

SlyEcho committed 2 years ago

Verified acc111ca

Update Makefile: clean simple (#2097)

ZhouYuChen committed 2 years ago

Verified 23c7c6fc

CI: make the brew update temporarily optional. (#2092)

Green-Sky committed 2 years ago

Verified 698efad5

[ggml] fix index for ne03 value in ggml_cl_mul_f32 (#2088)

gotope committed 2 years ago

Verified 14a2cc71

fix server crashes (#2076)

SlyEcho committed 2 years ago

Verified 1cf14cce

Fix crash of test-tokenizer-0 under Debug build (#2064)

howard0su committed 2 years ago

Verified cc45a7fe

[llama] No need to check file version when loading vocab score (#2079)

howard0su committed 2 years ago

Verified 55dbb915

server: add option to output probabilities for completion (#1962)

WangHaoranRobin committed 2 years ago

Verified d7d2e6a0

ggml : fix build with OpenBLAS (close #2066)

ggerganov committed 2 years ago

46088f72

Better CUDA synchronization logic (#2057)

JohannesGaessler committed 2 years ago

Verified 0bc2cdfc

Older