ggerganov/llama.cpp

Pull Requests Commits

llama : compute BERT graph with F16 K, V

ggerganov committed 1 year ago

Verified 0ba20ed9

llama-bench : add embeddings option (#5924)

ggerganov committed 1 year ago

Verified 6cdabe65

Revert "[SYCL] fix error when set main gpu to non-zero (#5901)" (#5918)

NeoZhangJianyu committed 1 year ago

Verified 89fb735f

server : add `/v1/completions` endpoint (#5914)

mscheong01 committed 1 year ago

Verified 55a2a900

server : refactor (#5882)

ggerganov committed 1 year ago

Verified 2002bc96

[SYCL] fix error when set main gpu to non-zero (#5901)

NeoZhangJianyu committed 1 year ago

Verified ceca1aef

ggml : use SYS_get_cpu if SYS_getcpu is not defined (#5906)

cebtenzzre committed 1 year ago

Verified e04e04f8

ggml : use `uint8x16_t` return type for `ggml_vqtbl1q_u8` (#5894)

bobqianic committed 1 year ago

Verified e25fb4b1

convert : remove AWQ remnants (#5768)

ggerganov committed 1 year ago

Verified 1e35d619

add wait() to make code stable (#5895)

NeoZhangJianyu committed 1 year ago

Verified 8ced9f7e

compare-llama-bench.py : remove mul_mat_q (#5892)

slaren committed 1 year ago

Verified 652ca2bd

quants : use MM256_SET_M128I consistently to fix gcc 7 build (#5889)

cebtenzzre committed 1 year ago

Verified bd836944

grammars : blacklists character control set (#5888)

ExtReMLapin committed 1 year ago

Verified 3de31677

Revert "grammars : don't allow to output unescaped new line in string (#5885)"

ggerganov committed 1 year ago

Verified 82cb31eb

grammars : don't allow to output unescaped new line in string (#5885)

ExtReMLapin committed 1 year ago

Verified b1a4e994

Vulkan Improvements (#5835)

0cc4m committed 1 year ago

Verified 61d1c88e

[SYCL] fix mul_mat fault in CI/unit-test (#5862)

NeoZhangJianyu committed 1 year ago

Verified 21b08674

fix editorconfig check break (#5879)

mscheong01 committed 1 year ago

Verified 6a87ac3a

fix speculative decoding build on windows (#5874)

jquesnelle committed 1 year ago

Verified 29eee404

nix: static build (#5814)

hutli committed 1 year ago

Verified 1d41d6f7

llama : fix embeddings (#5796)

ggerganov committed 1 year ago

Verified 29ae62d2

ggerganov committed 1 year ago

Verified e0843afe

ggml : fix unknown status (#0)

ggerganov committed 1 year ago

a1c6d96e

ggerganov committed 1 year ago

efd8533e

ggml : introduce ggml_status (ggml/750)

Xarbirus committed 1 year ago

9fa26273

cmake : handle cases where git index is not found in .git (#5844)

danemadsen committed 1 year ago

Verified fe52be11

speculative : implement stochastic speculative sampling (#5625)

mscheong01 committed 1 year ago

Verified 6d341ab6

add alias for chat template (#5858)

ngxson committed 1 year ago

Verified 4ffcdce2

ggerganov committed 1 year ago

Verified a0fc6266

add some new ops, fix some operators and add batch operations to certain operators. (ggml/747)

leejet committed 1 year ago

Verified 7d43c585

Older