ggml-org/llama.cpp

Pull Requests Commits

tests : avoid creating RNGs for each tensor

ggerganov committed 1 year ago

Verified 49bafe09

tests : avoid creating RNGs for each Q tensor

ggerganov committed 1 year ago

Verified 8eb8fd94

cuda : fix out-of-bounds-access in `mul_mat_vec_q`

ggerganov committed 1 year ago

Verified b7ddc8bf

ci : enable LLAMA_CUBLAS=1 for CUDA nodes

ggerganov committed 1 year ago

Verified 36feaeb4

cuda : update supports_op for IQ2

ggerganov committed 1 year ago

Verified e9a5d54b

ggml : add IQ2 to test-backend-ops + refactoring

ggerganov committed 1 year ago

Verified bc0bb300

nix: remove nixConfig from flake.nix (#4984)

philiptaron committed 1 year ago

Verified bee938da

finetune : add training data file to log message (#4979)

danbev committed 1 year ago

Verified cec8a484

ggml : importance matrix support for legacy quants (#4969)

ikawrakow committed 1 year ago

Verified 334a835a

examples : add complete parallel function calling example (#4974)

Maximilian-Winter committed 1 year ago

Verified 4feb4b33

perplexity : fix kv cache handling for hellaswag (#4981)

ggerganov committed 1 year ago

Verified 959ef0c0

flake.lock: update flake-parts, flake-parts/nixpkgs-lib, and nixpkgs (#4920)

ggerganov committed 1 year ago

Verified c37b3474

metal : localized logic in `ggml_metal_graph_compute` (#4924)

ptsochantaris committed 1 year ago

Verified 158f8c9e

android : introduce starter project example (#4926)

luciferous committed 1 year ago

Verified 862f5e41

metal : replace loop of dispatch_async with dispatch_apply (#4934)

azarovalex committed 1 year ago

Verified 3a48d558

metal : log `recommendedMaxWorkingSetSize` on iOS 16+ (#4936)

azarovalex committed 1 year ago

Verified 7c8d3abd

examples : fix and improv docs for the grammar generator (#4909)

Maximilian-Winter committed 1 year ago

Verified 122ed484

ggml : introduce GGML_CALL function annotation (#4850)

jart committed 1 year ago

Verified a0b3ac8c

finetune : use LLAMA_FILE_MAGIC_GGLA (#4961)

danbev committed 1 year ago

Verified d75c232e

speculative : threading options (#4959)

stduhpf committed 1 year ago

Verified e0324285

pass cpu-architecture arguments only to host code (C;C++) (#4943)

ngc92 committed 1 year ago

Verified 3e5ca793

llama : apply classifier-free guidance to logits directly (#4951)

dfriehs committed 1 year ago

Verified 44833967

awq-py : fix typo in awq-py/README.md (#4947)

ziliangpeng committed 1 year ago

Verified d9aa4ffa

cuda : fix dequantize kernel names (#4938)

ggerganov committed 1 year ago

Verified ddb008d8

llama : check for 256 divisibility for IQ2_XS, IQ2_XXS (#4950)

ikawrakow committed 1 year ago

Verified 2faaef39

CUDA: faster dequantize kernels for Q4_0 and Q4_1 (#4938)

ikawrakow committed 1 year ago

Verified 4a3156de

llama : fix missing quotes (#4937)

David Pflug committed 1 year ago

Verified a836c8f5

Add ability to use importance matrix for all k-quants (#4930)

ikawrakow committed 1 year ago

Verified 467a882f

llama : check LLAMA_TRACE env for extra logging (#4929)

ggerganov committed 1 year ago

Verified bb0c1392

scripts : sync-ggml-am.sh option to skip commits

ggerganov committed 1 year ago

Verified 9408cfda

Older