ggerganov/llama.cpp

Pull Requests Commits

cmake : provide binary dir

ggerganov committed 2 years ago

Verified 007f2ece

android : do not fetch, use add_subdirectory instead

ggerganov committed 2 years ago

Verified 99d1e7eb

ggml : disable SIMD exp and silu for 32-bit ARM

ggerganov committed 2 years ago

Verified 2117b303

android : use "ci-android" branch for CI

ggerganov committed 2 years ago

Verified 87259373

Added a single test function script and fix debug-test.sh to be more robust (#7279)

mofosyne committed 2 years ago

Verified 51e9d025

py : convert-hf-to-gguf-update improvements (#7340)

akx committed 2 years ago

Verified d273c140

llama : use n_embd_head_v when reshaping kqv (#7327)

fairydreaming committed 2 years ago

Verified 27b04069

tokenization: add warning for double BOS (#7332)

JohannesGaessler committed 2 years ago

Verified 29c60d8c

ggml-quants, llama : removed excess checks (#7274)

GermanAizek committed 2 years ago

Verified 359cbe3f

convert : fix Qwen/Qwen-7b conversion (#7308)

amd-lalithnc committed 2 years ago

Verified e18bc6aa

server : add support for the RPC backend (#7305)

rgerganov committed 2 years ago

Verified ee94172d

ggml : rewrite silu and softmax for cpu (#7154)

jart committed 2 years ago

Verified 934266c0

[Server] Added --verbose option to README [no ci] (#7335)

reuank committed 2 years ago

Verified 9c4fdcbe

Revert "server bench: fix bench not waiting for model load (#7284)" (#7334)

phymbert committed 2 years ago

Verified 24ecb581

rpc : get available mem for the CPU backend

rgerganov committed 2 years ago

9afdffe7

rpc : add command line arg for specifying backend memory

rgerganov committed 2 years ago

3b3963c5

convert : get general.name from model dir, not its parent (#5615)

cebtenzzre committed 2 years ago

Verified dda64fc1

grammar, json, llama: replace push on emplace if it possible (#7273)

GermanAizek committed 2 years ago

Verified 0350f581

doc: add references to hugging face GGUF-my-repo quantisation web tool. (#7288)

Vaibhavs10 committed 2 years ago

Verified ad52d5c2

ci: fix bin/Release path for windows-arm64 builds (#7317)

max-krasnyansky committed 2 years ago

Verified 172b7821

Add support for properly optimized Windows ARM64 builds with LLVM and MSVC (#7191)

max-krasnyansky committed 2 years ago

Verified 13ad16af

readme : remove stray double quote (#7310)

danbev committed 2 years ago

Verified 8f7080bf

ggml : use dynamic thread scheduling for matrix multiplication (#6915)

kunnis committed 2 years ago

Verified e1b40ac3

Avoid unnecessarily disabling CUDA graphs (#7302)

agray3 committed 2 years ago

Verified dc020985

ggml : tag ggml_tensor::backend as deprecated (#7290)

slaren committed 2 years ago

Verified 344f9126

Add missing " (#7303)

AidanBeltonS committed 2 years ago

Verified 9a17ab91

embedding : free the batch after execution (#7297)

dm4 committed 2 years ago

Verified ea3b0590

ggerganov committed 2 years ago

Verified 29499bb5

ggml : add `ggml_upscale_ext` (ggml/814)

balisujohn committed 2 years ago

Verified 48aa8fd1

server bench: fix bench not waiting for model load (#7284)

JohannesGaessler committed 2 years ago

Verified 583fd6b0

Older