ggml-org/llama.cpp

Pull Requests Commits

script : sync ggml-rpc

ggerganov committed 1 year ago

Verified 9f773486

metal : support FA without mask + add asserts (#7278)

ggerganov committed 1 year ago

Verified e8a7fd4f

ggerganov committed 1 year ago

a5e3fde8

metal : tune soft_max number of threads (whisper/0)

ggerganov committed 1 year ago

f308ea70

ggml : try fix ppc64 (whisper/0)

ggerganov committed 1 year ago

c3c88f29

ggml : expose SSE3 and SSSE3 for MSVC when AVX is available (whisper/2128)

przemoc committed 1 year ago

182adefc

ggml : optimize for ppc64le using VSX intrinsics (ggml/784)

penghongbo committed 1 year ago

0d26d8cc

server: free sampling contexts on exit (#7264)

stevegrubb committed 1 year ago

Verified 4f026363

Revert "move ndk code to a new library (#6951)" (#7282)

mofosyne committed 1 year ago

Verified 1265c670

ggml : add RPC backend (#6829)

rgerganov committed 1 year ago

Verified 5e31828d

llama : disable pipeline parallelism with nkvo (#7265)

slaren committed 1 year ago

Verified 54160020

move ndk code to a new library (#6951)

eltonkola committed 1 year ago

Verified efc8f767

Add left recursion check: quit early instead of going into an infinite loop (#7083)

nuchi committed 1 year ago

Verified e0f55618

docs: Fix typo and update description for --embeddings flag (#7026)

louixs committed 1 year ago

Verified 27f65d62

convert-hf : support direct Q8_0 conversion (#7234)

compilade committed 1 year ago

Verified ee522250

llama : less KV padding when FA is off (#7257)

ggerganov committed 1 year ago

Verified 614d3b91

llava-cli: fix base64 prompt (#7248)

Adriankhl committed 1 year ago

Verified 30e70334

perplexity: add BF16 vs. FP16 results (#7150)

JohannesGaessler committed 1 year ago

Verified 1c570d8b

[SYCL] rm wait() (#7233)

arthw committed 1 year ago

Verified 948f4ec7

llama : rename jina tokenizers to v2 (#7249)

JoanFM committed 1 year ago

Verified 9aa67249

convert.py: Outfile default name change and additional metadata support (#4858)

mofosyne committed 1 year ago

Verified b1f8af18

change default temperature of OAI compat API from 0 to 1 (#7226)

Kartoffelsaft committed 1 year ago

Verified e586ee42

[SYCL] Add oneapi runtime dll files to win release package (#7241)

arthw committed 1 year ago

Verified cbf75894

[SYCL] update CI with oneapi 2024.1 (#7235)

arthw committed 1 year ago

Verified 0d5cef78

CUDA: add FP32 FlashAttention vector kernel (#7188)

JohannesGaessler committed 1 year ago

Verified dc685be4

cmake : fix version cmp (#7227)

ggerganov committed 1 year ago

Verified 6f1b6360

remove convert-lora-to-ggml.py (#7204)

slaren committed 1 year ago

Verified b228aba9

metal : fix warnings (skipme) (#0)

ggerganov committed 1 year ago

Verified 7bd4ffb7

ggerganov committed 1 year ago

Verified 1622ac02

metal : fix indent (ggml/0)

ggerganov committed 1 year ago

Verified 6aeff24f

Newer Older