ggerganov/llama.cpp

Pull Requests Commits
ggml-cuda : perform cublas fp16 matrix multiplication as fp16 (#3370)
slaren committed 2 years ago
Verified da040034
convert : remove bug in convert.py permute function (#3364)
jzhang38 committed 2 years ago
Verified e5196210
make-ggml.py : compatibility with more models and GGUF (#3290)
richardr1126 committed 2 years ago
Verified ac435761
gguf : fix a few general keys (#3341)
cebtenzzre committed 2 years ago
Verified 20c7e1e8
metal : reusing llama.cpp logging (#3152)
Ricardicus committed 2 years ago
Verified dc689740
build : add ACCELERATE_NEW_LAPACK to fix warning on macOS Sonoma (#3342)
jagtesh committed 2 years ago
Verified 527e57cf
readme : add some recent perplexity and bpw measurements to READMES, link for k-quants (#3340)
BarfingLemurs committed 2 years ago
Verified ffe88a36
cmake : fix build-info.h on MSVC (#3309)
dranger003 committed 2 years ago
Verified 99115f3f
docs: Fix typo CLBlast_DIR var. (#3330)
2f38b454 committed 2 years ago
Verified 1726f962
nix : add cuda, use a symlinked toolkit for cmake (#3202)
Green-Sky committed 2 years ago
Verified a98b1633
llama-bench : add README (#3317)
slaren committed 2 years ago
Verified c091cdfb
examples : fix RoPE defaults to match PR #3240 (#3315)
cebtenzzre committed 2 years ago
Verified 51a7cf5c
scripts : use `/usr/bin/env` in shebang (#3313)
kevinji committed 2 years ago
Verified bedb92b6
Update README.md (#3289)
leedrake5 committed 2 years ago
Verified bc9d3e39
ggml-opencl.cpp: Make private functions static (#3300)
shibe2 committed 2 years ago
Verified 36b904e2
zig : fix for updated c lib (#3259)
edeetee committed 2 years ago
Verified 324f3403
embedding : update README.md (#3224)
yuiseki committed 2 years ago
Verified f56c418a
CUDA: use only 1 thread if fully offloaded (#2915)
JohannesGaessler committed 2 years ago
Verified 8185710a
readme : update hot topics
ggerganov committed 2 years ago
Verified 7eb41179
llama : allow gguf RoPE keys to be overridden with defaults (#3240)
cebtenzzre committed 2 years ago
Verified a5661d7e
benchmark-matmult : do not use integer abs() on a float (#3277)
cebtenzzre committed 2 years ago
Verified 65c2c1c5
flake : Restore default package's buildInputs (#3262)
tpdns90321 committed 2 years ago
Verified 80834dae
CI: FreeBSD fix (#3258)
alonfaraj committed 2 years ago
Verified a40f2b65
examples : fix benchmark-matmult (#1554)
ggerganov committed 2 years ago
Verified d119c04c
make : restore build-info.h dependency for several targets (#3205)
cebtenzzre committed 2 years ago
Verified 8781013e
ci : switch cudatoolkit install on windows to networked (#3236)
Green-Sky committed 2 years ago
Verified 7ddf1855
CUDA: fix peer access logic (#3231)
JohannesGaessler committed 2 years ago
Verified ee66942d
CUDA: enable peer access between devices (#2470)
JohannesGaessler committed 2 years ago
Verified 111163e2
llama.cpp : show model size and BPW on load (#3223)
slaren committed 2 years ago
Verified 8b428c9b
CUDA: fix scratch malloced on non-main device (#3220)
JohannesGaessler committed 2 years ago
Verified 578d8c8f
Terms Of Use Privacy Policy Refund Policy Impressum