ggml-org/llama.cpp

Pull Requests Commits
convert : fix set_vocab_sentencepiece (#6866)
ggerganov committed 1 year ago
Verified b49a13dd
ggml : fix quants nans when all the group weights are very close to zero (#7313)
slaren committed 1 year ago
Verified 05834841
cmake : fix typo in AMDGPU_TARGETS (#7356)
Engininja2 committed 1 year ago
Verified ef277de2
Unicode codepoint flags for custom regexs (#7245)
jaime-m-p committed 1 year ago
Verified b43272af
CUDA: faster large batch FA without tensor cores (#7314)
JohannesGaessler committed 1 year ago
Verified 0fc1e820
ROCm: use native CMake HIP support (#5966)
GZGavinZhao committed 1 year ago
Verified 82ca83db
rpc : set SO_REUSEADDR for the server socket (#7320)
rgerganov committed 1 year ago
Verified f4bd8b3d
Added a single test function script and fix debug-test.sh to be more robust (#7279)
mofosyne committed 1 year ago
Verified 51e9d025
py : convert-hf-to-gguf-update improvements (#7340)
akx committed 1 year ago
Verified d273c140
llama : use n_embd_head_v when reshaping kqv (#7327)
fairydreaming committed 1 year ago
Verified 27b04069
tokenization: add warning for double BOS (#7332)
JohannesGaessler committed 1 year ago
Verified 29c60d8c
ggml-quants, llama : removed excess checks (#7274)
GermanAizek committed 1 year ago
Verified 359cbe3f
convert : fix Qwen/Qwen-7b conversion (#7308)
amd-lalithnc committed 1 year ago
Verified e18bc6aa
server : add support for the RPC backend (#7305)
rgerganov committed 1 year ago
Verified ee94172d
ggml : rewrite silu and softmax for cpu (#7154)
jart committed 1 year ago
Verified 934266c0
[Server] Added --verbose option to README [no ci] (#7335)
reuank committed 1 year ago
Verified 9c4fdcbe
Revert "server bench: fix bench not waiting for model load (#7284)" (#7334)
phymbert committed 1 year ago
Verified 24ecb581
rpc : get available mem for the CPU backend
rgerganov committed 1 year ago
9afdffe7
rpc : add command line arg for specifying backend memory
rgerganov committed 1 year ago
3b3963c5
convert : get general.name from model dir, not its parent (#5615)
cebtenzzre committed 1 year ago
Verified dda64fc1
grammar, json, llama: replace push on emplace if it possible (#7273)
GermanAizek committed 1 year ago
Verified 0350f581
doc: add references to hugging face GGUF-my-repo quantisation web tool. (#7288)
Vaibhavs10 committed 1 year ago
Verified ad52d5c2
ci: fix bin/Release path for windows-arm64 builds (#7317)
max-krasnyansky committed 1 year ago
Verified 172b7821
Add support for properly optimized Windows ARM64 builds with LLVM and MSVC (#7191)
max-krasnyansky committed 1 year ago
Verified 13ad16af
readme : remove stray double quote (#7310)
danbev committed 1 year ago
Verified 8f7080bf
ggml : use dynamic thread scheduling for matrix multiplication (#6915)
kunnis committed 1 year ago
Verified e1b40ac3
Avoid unnecessarily disabling CUDA graphs (#7302)
agray3 committed 1 year ago
Verified dc020985
ggml : tag ggml_tensor::backend as deprecated (#7290)
slaren committed 1 year ago
Verified 344f9126
Add missing " (#7303)
AidanBeltonS committed 1 year ago
Verified 9a17ab91
embedding : free the batch after execution (#7297)
dm4 committed 1 year ago
Verified ea3b0590
Terms Of Use Privacy Policy Refund Policy Impressum