ggerganov/llama.cpp

Pull Requests Commits

Merge branch 'master' into gg/imatrix-gpu-4931

ggerganov committed 1 year ago

Verified 2917e6b5

backend : add eval callback (#4935)

ggerganov committed 1 year ago

Verified 44a1a4a4

metal : create autorelease pool during library build (#4970)

ggerganov committed 1 year ago

Verified c918fe8d

py : fix whitespace

ggerganov committed 1 year ago

Verified 0f83e727

py : fix missing added_tokens_dict for SPM and BPE vocabs (#4971)

ggerganov committed 1 year ago

Verified 4f4bf35f

ci : rearrange output

ggerganov committed 1 year ago

Verified 4fb52843

ci : add imatrix test

ggerganov committed 1 year ago

Verified 10b25e03

imatrix : fix ggml_mul_mat_id hanlding

ggerganov committed 1 year ago

Verified a722d05a

llama : use Q4_K for attn_v for Q2_K_S when n_gqa >= 4 (#4996)

ikawrakow committed 1 year ago

Verified 2b3a665d

metal : remove unnecessary nil check (#4986)

ptsochantaris committed 1 year ago

Verified 75632936

llama : fix copy/paste error in llama_sampling_params comment (#4994)

dwrensha committed 1 year ago

Verified f46c0c1b

py : remove unnecessary hasattr (#4903)

ggerganov committed 1 year ago

Verified 5c999609

nix: remove nixConfig from flake.nix (#4984)

philiptaron committed 1 year ago

Verified bee938da

finetune : add training data file to log message (#4979)

danbev committed 1 year ago

Verified cec8a484

ggml : importance matrix support for legacy quants (#4969)

ikawrakow committed 1 year ago

Verified 334a835a

examples : add complete parallel function calling example (#4974)

Maximilian-Winter committed 1 year ago

Verified 4feb4b33

perplexity : fix kv cache handling for hellaswag (#4981)

ggerganov committed 1 year ago

Verified 959ef0c0

flake.lock: update flake-parts, flake-parts/nixpkgs-lib, and nixpkgs (#4920)

ggerganov committed 1 year ago

Verified c37b3474

metal : localized logic in `ggml_metal_graph_compute` (#4924)

ptsochantaris committed 1 year ago

Verified 158f8c9e

android : introduce starter project example (#4926)

luciferous committed 1 year ago

Verified 862f5e41

metal : replace loop of dispatch_async with dispatch_apply (#4934)

azarovalex committed 1 year ago

Verified 3a48d558

metal : log `recommendedMaxWorkingSetSize` on iOS 16+ (#4936)

azarovalex committed 1 year ago

Verified 7c8d3abd

examples : fix and improv docs for the grammar generator (#4909)

Maximilian-Winter committed 1 year ago

Verified 122ed484

ggml : introduce GGML_CALL function annotation (#4850)

jart committed 1 year ago

Verified a0b3ac8c

finetune : use LLAMA_FILE_MAGIC_GGLA (#4961)

danbev committed 1 year ago

Verified d75c232e

speculative : threading options (#4959)

stduhpf committed 1 year ago

Verified e0324285

pass cpu-architecture arguments only to host code (C;C++) (#4943)

ngc92 committed 1 year ago

Verified 3e5ca793

imatrix : offload to GPU support

ggerganov committed 1 year ago

Verified 0b2fca9a

ggerganov committed 1 year ago

Verified e0493800

simple : do not perform tensor data copy if not needed

ggerganov committed 1 year ago

Verified e1b1db9f

Older