ggml-org/llama.cpp

Pull Requests Commits

metal : opt mul_mm_id

ggerganov committed 1 year ago

Verified 9f51f3e6

Merge branch 'master' into gg/metal-opt-mul-mat-id

ggerganov committed 1 year ago

Verified 21e100d6

llama : llama_model_desc print number of experts

ggerganov committed 1 year ago

Verified 540938f8

metal : minor fix

ggerganov committed 1 year ago

Verified daf9b124

Merge branch 'master' into gg/metal-opt-mul-mat-id

ggerganov committed 1 year ago

Verified 74460d00

Merge branch 'master' into gg/metal-opt-mul-mat-id

ggerganov committed 1 year ago

Verified c73e598d

llama : replace all API facing `int`'s with `int32_t` (#4577)

MarcusDunn committed 1 year ago

Verified 0040d42e

llama : differentiate the KV dims in the attention (#4657)

postmasters committed 1 year ago

Verified 83e633c2

editorconfig : fix whitespace and indentation #4710

ggerganov committed 1 year ago

Verified 32866c5e

server : add --override-kv parameter (#4710)

minarchist committed 1 year ago

Verified 5d7002d4

py : re-enable mmap in convert hf (#4732)

namtranase committed 1 year ago

Verified 26f3071d

finetune: fix typo in README.md (#4733)

danbev committed 1 year ago

Verified 775ac871

metal : enable shader debugging (cmake option) (#4705)

ggerganov committed 1 year ago

Verified 58ba655a

metal : optimizing ggml_mul_mat_id (wip)

ggerganov committed 1 year ago

Verified 76f9d41d

flake.lock: update

SomeoneSerge committed 1 year ago

edd1ab7b

flake.nix: suggest the binary caches

SomeoneSerge committed 1 year ago

198ed7eb

workflows: nix-ci: add a qemu job for jetsons

SomeoneSerge committed 1 year ago

d8361747

workflows: nix-flakestry: drop tag filters

SomeoneSerge committed 1 year ago

06f2a5d1

workflows: weekly `nix flake update`

SomeoneSerge committed 1 year ago

c5239944

workflows: nix-ci: add a job for eval

SomeoneSerge committed 1 year ago

1e9ae54c

workflows: nix-ci: init; build flake outputs

SomeoneSerge committed 1 year ago

7adedecb

flake.nix: expose checks

SomeoneSerge committed 1 year ago

356ea17e

flake.nix: rocm not yet supported on aarch64, so hide the output

SomeoneSerge committed 1 year ago

a5c088d8

flake.nix: expose full scope in legacyPackages

SomeoneSerge committed 1 year ago

1e3900eb

metal : fix mat-vec Q4_K kernel for QK_K == 64

ggerganov committed 1 year ago

Verified 5865b18e

cmake : respect LLAMA_QKK_64 option

ggerganov committed 1 year ago

Verified a8b9bb45

metal : normalize mat-vec kernel signatures

ggerganov committed 1 year ago

Verified 049a32ff

metal : fix mat-vec Q8_0 kernel for BS > 1

ggerganov committed 1 year ago

Verified ad7cf37f

cmake : rename option to LLAMA_METAL_SHADER_DEBUG

ggerganov committed 1 year ago

Verified 6435a3de

metal : use uint64_t for strides

ggerganov committed 1 year ago

Verified 4c054d98

Older