ggerganov/llama.cpp

Pull Requests Commits

Fix directory name

SlyEcho committed 2 years ago

Verified 20054a38

Some improvements to loading the session with --prompt-cache (#1550)

KerfuffleV2 committed 2 years ago

Verified 66874d4f

cuda : performance optimizations (#1530)

JohannesGaessler committed 2 years ago

Verified 1fcdcc28

Update CLBlast to 1.6.0 (#1580)

SlyEcho committed 2 years ago

Verified ac7876ac

readme : add docs for chat-persistent.sh (#1568)

ejones committed 2 years ago

Verified c31bbe93

chat-persistent.sh : use bracket expressions in grep (#1564)

Senemu committed 2 years ago

Verified 1359b6ab

Fix handling of "invalid property" when creating OpenCL command queue (#1565)

mthuurne committed 2 years ago

Verified 7d873811

OpenCL Token Generation Acceleration (#1459)

0cc4m committed 2 years ago

Verified 2e6cd4b0

examples : add server example with REST API (#1443)

FSSRepo committed 2 years ago

Verified 7e4ea5be

make : .PHONY clean (#1553)

stsydow committed 2 years ago

Verified 7780e4f4

ggml : output 3d sizes in ggml_graph_dump_dot()

ggerganov committed 2 years ago

Verified 265db983

ggml : update WASM SIMD

ggerganov committed 2 years ago

Verified fab49c68

feature : support blis and other blas implementation (#1536)

zenixls2 committed 2 years ago

Verified b8ee340a

OpenCL: Fixes for older devices. (#1435)

SlyEcho committed 2 years ago

Verified 9ecb30f9

llama : define magic numbers as integer constants (#1518) (#1520)

imaami committed 2 years ago

Verified 29cf5596

ggml : add ggml_clamp() (#1539)

ggerganov committed 2 years ago

Verified 3de84b26

cuda : loading models directly into VRAM, norm calculation on GPU, broadcasting for ggml_mul (#1483)

JohannesGaessler committed 2 years ago

Verified affc76ed

Revert "feature : add blis and other BLAS implementation support (#1502)"

ggerganov committed 2 years ago

Verified ea600071

feature : add blis and other BLAS implementation support (#1502)

zenixls2 committed 2 years ago

Verified 07e9ace0

llama : add llama_init_backend() API (close #1527)

ggerganov committed 2 years ago

Verified ec2e10c4

Fix for mingw (#1462)

DannyDaemonic committed 2 years ago

Verified d2c59b8b

llama : fix name shadowing and C4146 (#1526)

maximegmd committed 2 years ago

Verified 503db288

llama : fix compile warnings in llama_set_state_data()

ggerganov committed 2 years ago

8a203f9f

ggml : fix scalar implementation of Q4_1 dot

ggerganov committed 2 years ago

4fd3e292

ggml : use F16 instead of F32 in Q4_0, Q4_1, Q8_0 (#1508)

ggerganov committed 2 years ago

Verified 2d5db483

tests : add missing header

ggerganov committed 2 years ago

Verified 6986c783

examples : add persistent chat (#1495)

ejones committed 2 years ago

Verified 943e6081

main : make reverse prompt option act as a stop token in non-interactive mode (#1032)

data-angel committed 2 years ago

Verified 7694b52b

readme : adds WizardLM to the list of supported models (#1485)

dakennedyd committed 2 years ago

Verified 79e3efb0

minor : fix compile warnings

ggerganov committed 2 years ago

Verified 4b7e245a

Older