ggerganov/llama.cpp

Pull Requests Commits
imatrix : fix assert for src0 non-cont check
ggerganov committed 1 year ago
Verified 2d5419d0
perplexity : fix winogrande N tasks option
ggerganov committed 1 year ago
Verified d391ae9b
scripts : add get-winogrande.sh
ggerganov committed 1 year ago
Verified e9240cdf
convert.py : fix llama/llama2 conversion due to vocab_size=-1 (#5019)
databyte committed 1 year ago
Verified b4675773
HellaSwag: speed up by parallelizing log-prob evaluation (#5020)
ikawrakow committed 1 year ago
Verified 3e945cc1
ggml : add ggml_flash_attn_ext API
ggerganov committed 1 year ago
Verified a1c004ef
perplexity : faster HellaSwag via batching (#5017)
ggerganov committed 1 year ago
Verified ad19812c
Add Winogrande evaluation (#5015)
ikawrakow committed 1 year ago
Verified 682986a0
scritps : add helper script to get hellaswag data in txt format
ggerganov committed 1 year ago
Verified dcad445d
metal : fix memory leak, dangling pointer and unused autorel (#5007)
ptsochantaris committed 1 year ago
Verified 1e605f41
sync : ggml
ggerganov committed 1 year ago
Verified 6b6916b2
ggml : add IQ2 to test-backend-ops + refactoring (#4990)
ggerganov committed 1 year ago
Verified 38566680
imatrix : offload to GPU support (#4957)
ggerganov committed 1 year ago
Verified ba69bbc8
backend : add eval callback (#4935)
ggerganov committed 1 year ago
Verified 44a1a4a4
metal : create autorelease pool during library build (#4970)
ggerganov committed 1 year ago
Verified c918fe8d
py : fix whitespace
ggerganov committed 1 year ago
Verified 0f83e727
py : fix missing added_tokens_dict for SPM and BPE vocabs (#4971)
ggerganov committed 1 year ago
Verified 4f4bf35f
llama : use Q4_K for attn_v for Q2_K_S when n_gqa >= 4 (#4996)
ikawrakow committed 1 year ago
Verified 2b3a665d
metal : remove unnecessary nil check (#4986)
ptsochantaris committed 1 year ago
Verified 75632936
llama : fix copy/paste error in llama_sampling_params comment (#4994)
dwrensha committed 1 year ago
Verified f46c0c1b
py : remove unnecessary hasattr (#4903)
ggerganov committed 1 year ago
Verified 5c999609
nix: remove nixConfig from flake.nix (#4984)
philiptaron committed 1 year ago
Verified bee938da
finetune : add training data file to log message (#4979)
danbev committed 1 year ago
Verified cec8a484
ggml : importance matrix support for legacy quants (#4969)
ikawrakow committed 1 year ago
Verified 334a835a
examples : add complete parallel function calling example (#4974)
Maximilian-Winter committed 1 year ago
Verified 4feb4b33
perplexity : fix kv cache handling for hellaswag (#4981)
ggerganov committed 1 year ago
Verified 959ef0c0
flake.lock: update flake-parts, flake-parts/nixpkgs-lib, and nixpkgs (#4920)
ggerganov committed 1 year ago
Verified c37b3474
metal : localized logic in `ggml_metal_graph_compute` (#4924)
ptsochantaris committed 1 year ago
Verified 158f8c9e
android : introduce starter project example (#4926)
luciferous committed 1 year ago
Verified 862f5e41
metal : replace loop of dispatch_async with dispatch_apply (#4934)
azarovalex committed 1 year ago
Verified 3a48d558
Terms Of Use Privacy Policy Refund Policy Impressum