ggerganov/llama.cpp

Pull Requests Commits
Add support for sqrt on CUDA (#7953)
calvin-laurenson committed 1 year ago
Verified 43b35e38
cuda : fix bounds check for src0 rows in MMVQ kernel (whisper/2231)
ggerganov committed 1 year ago
Verified 19b7a836
ggml : fix and optimize ppc64le (ggml/849)
penghongbo committed 1 year ago
Verified b5fcf8ef
ggml : remove duplicate include of ggml-common.h (ggml/853)
danbev committed 1 year ago
Verified 398105ff
flake.lock: Update (#7951)
ggerganov committed 1 year ago
Verified bc6c457f
unicode : avoid char32_t (#7957)
ggerganov committed 1 year ago
Verified 52399254
readme : update UI list [no ci] (#7958)
hopkins385 committed 1 year ago
Verified 6fe1c627
ggml : fix handling of zero blocks in IQ quants (#7955)
ggerganov committed 1 year ago
Verified cddaf028
github : update pr template
ggerganov committed 1 year ago
Verified c8a82194
Vulkan Shader Refactor, Memory Debugging Option (#7947)
0cc4m committed 1 year ago
Verified 7c7836d9
Add `cvector-generator` example (#7514)
ngxson committed 1 year ago
Verified 0c7b3595
[SYCL] remove global variables (#7710)
airMeng committed 1 year ago
Verified 7b2f4a7d
ci : fix macos x86 build (#7940)
olexiyb committed 1 year ago
Verified f8ec8877
CUDA: faster q2_K, q3_K MMQ + int8 tensor cores (#7921)
JohannesGaessler committed 1 year ago
Verified 76d66ee0
metal : utilize max shared memory for mul_mat_id (#7935)
ggerganov committed 1 year ago
Verified 66ef1cee
llama-bench : fix RPC indication (#7936)
rgerganov committed 1 year ago
Verified e65bbf60
llama : more checks before assuming FIM tokens (#7644)
CISC committed 1 year ago
Verified 6fcd1331
convert : add Poro-34B-chat tokenizer support (#7713)
ezosa committed 1 year ago
Verified 41b9260f
rpc : fix ggml_backend_rpc_supports_buft() (#7918)
rgerganov committed 1 year ago
Verified 172c8256
readme : Remove outdated instructions from README.md (#7914) [no ci]
Galunid committed 1 year ago
Verified a55eb1bf
move BLAS to a separate backend (#6210)
slaren committed 1 year ago
Verified f578b86b
`build`: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
ochafik committed 1 year ago
Verified 1c641e6a
CUDA: fix broken oob check for FA vec f32 kernel (#7904)
JohannesGaessler committed 1 year ago
Verified 96355290
tests : add non-cont unary tests (#7857)
ggerganov committed 1 year ago
Verified a9cae480
ggml : improve ggml_is_contiguous logic (#7856)
ggerganov committed 1 year ago
Verified bfaa676b
server : restore numeric prompts (#7883)
ggerganov committed 1 year ago
Verified 704a35b1
update intel docker oneapi-basekit to 2024.1.1-devel-ubuntu22.04 (#7894)
airMeng committed 1 year ago
Verified dcf75270
Fix a typo and add Fedora 40 pacakge to install for Vulkan (#7794) [no ci]
metal3d committed 1 year ago
Verified f2b5764b
vulkan: select only one device for single gpu with multiple drivers (#7582)
Adriankhl committed 1 year ago
Verified 73bac2b1
Update Vulkan RoPE implementation (#7818)
0cc4m committed 1 year ago
Verified ef52d1d1
Terms Of Use Privacy Policy Refund Policy Impressum