ochafik/llama.cpp

Pull Requests Commits
rpc : add command line arg for specifying backend memory
rgerganov committed 2 years ago
3b3963c5
convert : get general.name from model dir, not its parent (#5615)
cebtenzzre committed 2 years ago
Verified dda64fc1
grammar, json, llama: replace push on emplace if it possible (#7273)
GermanAizek committed 2 years ago
Verified 0350f581
doc: add references to hugging face GGUF-my-repo quantisation web tool. (#7288)
Vaibhavs10 committed 2 years ago
Verified ad52d5c2
ci: fix bin/Release path for windows-arm64 builds (#7317)
max-krasnyansky committed 2 years ago
Verified 172b7821
Add support for properly optimized Windows ARM64 builds with LLVM and MSVC (#7191)
max-krasnyansky committed 2 years ago
Verified 13ad16af
readme : remove stray double quote (#7310)
danbev committed 2 years ago
Verified 8f7080bf
ggml : use dynamic thread scheduling for matrix multiplication (#6915)
kunnis committed 2 years ago
Verified e1b40ac3
Avoid unnecessarily disabling CUDA graphs (#7302)
agray3 committed 2 years ago
Verified dc020985
ggml : tag ggml_tensor::backend as deprecated (#7290)
slaren committed 2 years ago
Verified 344f9126
Add missing " (#7303)
AidanBeltonS committed 2 years ago
Verified 9a17ab91
embedding : free the batch after execution (#7297)
dm4 committed 2 years ago
Verified ea3b0590
sync : ggml
ggerganov committed 2 years ago
Verified 29499bb5
ggml : add `ggml_upscale_ext` (ggml/814)
balisujohn committed 2 years ago
Verified 48aa8fd1
server bench: fix bench not waiting for model load (#7284)
JohannesGaessler committed 2 years ago
Verified 583fd6b0
script : sync ggml-rpc
ggerganov committed 2 years ago
Verified 9f773486
metal : support FA without mask + add asserts (#7278)
ggerganov committed 2 years ago
Verified e8a7fd4f
sync : ggml
ggerganov committed 2 years ago
a5e3fde8
metal : tune soft_max number of threads (whisper/0)
ggerganov committed 2 years ago
f308ea70
ggml : try fix ppc64 (whisper/0)
ggerganov committed 2 years ago
c3c88f29
ggml : expose SSE3 and SSSE3 for MSVC when AVX is available (whisper/2128)
przemoc committed 2 years ago
182adefc
ggml : optimize for ppc64le using VSX intrinsics (ggml/784)
penghongbo committed 2 years ago
0d26d8cc
server: free sampling contexts on exit (#7264)
stevegrubb committed 2 years ago
Verified 4f026363
Revert "move ndk code to a new library (#6951)" (#7282)
mofosyne committed 2 years ago
Verified 1265c670
ggml : add RPC backend (#6829)
rgerganov committed 2 years ago
Verified 5e31828d
llama : disable pipeline parallelism with nkvo (#7265)
slaren committed 2 years ago
Verified 54160020
move ndk code to a new library (#6951)
eltonkola committed 2 years ago
Verified efc8f767
Add left recursion check: quit early instead of going into an infinite loop (#7083)
nuchi committed 2 years ago
Verified e0f55618
docs: Fix typo and update description for --embeddings flag (#7026)
louixs committed 2 years ago
Verified 27f65d62
convert-hf : support direct Q8_0 conversion (#7234)
compilade committed 2 years ago
Verified ee522250
Terms Of Use Privacy Policy Refund Policy Impressum