ggerganov/llama.cpp

Pull Requests Commits
common : use enums for sampler types (#5418)
z80maniac committed 1 year ago
Verified a803333a
server : allow to specify tokens as strings in logit_bias (#5003)
z80maniac committed 1 year ago
Verified 68478014
main : ctrl+C print timing in non-interactive mode (#3873)
ggerganov committed 1 year ago
Verified 85910c5b
common : fix compile warning
ggerganov committed 1 year ago
Verified 139b62a8
ggml : fix compile warnings (unused vars) (#4966)
ggerganov committed 1 year ago
Verified 0f2411f1
ggml : add mmla kernels for quantized GEMM (#4966)
snadampal committed 1 year ago
Verified a07d0fee
lookup: add print for drafting performance (#5450)
JohannesGaessler committed 1 year ago
Verified e4640d8f
server : add llama2 chat template (#5425)
ngxson committed 1 year ago
Verified 907e08c1
metal : use autoreleasepool to avoid memory leaks (#5437)
irbull committed 1 year ago
Verified f026f812
scripts : update sync scripts with new backends
ggerganov committed 1 year ago
Verified cd9aea63
sync : ggml
ggerganov committed 1 year ago
Verified 43b65f5e
ggml : add abort_callback for cpu backend (ggml/725)
Xarbirus committed 1 year ago
Verified 4633d93a
vulkan: Set limit for task concurrency (#5427)
luciferous committed 1 year ago
Verified 4b7b38be
llava : add requirements.txt and update README.md (#5428)
danbev committed 1 year ago
Verified e00d2a62
server : fix prompt caching for repeated prompts (#5420)
ristew committed 1 year ago
Verified 7c777fcd
llama : do not cap thread count when MoE on CPU (#5419)
ptsochantaris committed 1 year ago
Verified e5ca3937
readme : add JavaScript/Wasm repo (#5415)
mtasic85 committed 1 year ago
Verified e4124c24
ggml : fix `error C2078: too many initializers` for MSVC ARM64 (#5404)
Xarbirus committed 1 year ago
Verified b2f87cb6
Fix Vulkan crash on APUs with very little device memory (#5424)
0cc4m committed 1 year ago
Verified 44fbe343
CUDA: more warps for mmvq on NVIDIA (#5394)
JohannesGaessler committed 1 year ago
Verified 8e6a9d2d
llama : do not print "offloading layers" message in CPU-only builds (#5416)
slaren committed 1 year ago
Verified 41f308f5
Fix f16_sycl cpy call from Arc (#5411)
abhilash1910 committed 1 year ago
Verified 6e99f2a0
llava : add missing .py, and fix paths in README.md (#5414)
danbev committed 1 year ago
Verified ff4ff05c
fix trailing whitespace (#5407)
JohannesGaessler committed 1 year ago
Verified b7b74cef
llama : fix MiniCPM (#5392)
runfuture committed 1 year ago
Verified 4aa43fab
llava: fix typo/formatting in README.md (#5405)
danbev committed 1 year ago
Verified a6e514a8
sampling: fix top_k <= 0 (#5388)
JohannesGaessler committed 1 year ago
Verified 26d4efd1
tests : .gitignore obj files
ggerganov committed 1 year ago
Verified 8504d2d0
CMAKE_OSX_ARCHITECTURES for MacOS cross compilation (#5393)
Xarbirus committed 1 year ago
Verified c4fbb671
fix typo in readme (#5399)
ebeyabraham committed 1 year ago
Verified 8c933b70
Terms Of Use Privacy Policy Refund Policy Impressum