ggml-org/llama.cpp

Pull Requests Commits

vulkan/cuda: Fix im2col when KW!=KH (#14789)

jeffbolznv committed 59 days ago

Verified c2e058f1

llama : fix `--reverse-prompt` crashing issue (#14794)

MollySophia committed 59 days ago

Verified c82d48ec

server : add parse_special option to /tokenize endpoint (#14783)

IsaacDynamo committed 59 days ago

Verified b4efd77f

docs : fix link for tools/perplexity in README.md (#14780)

am17an committed 60 days ago

Verified 2be60cbc

Documentation: Further revisions to the Vulkan section in build.md (#14785)

rspOverflow committed 60 days ago

Verified b526ad26

Clang-format: local files first + fix BinPacking (#14779)

am17an committed 60 days ago

Verified 938b7857

Contrib: add 0cc4m as codeowner for Vulkan backend (#14775)

0cc4m committed 61 days ago

Verified 36c15324

ggml: adds CONV_2D op and direct GEMM Vulkan implementation (#14316)

etasnadi committed 61 days ago

Verified a979ca22

imatrix : use GGUF to store importance matrices (#9400)

compilade committed 61 days ago

Verified 90083283

vulkan: Add logging for bf16 features to ggml_vk_print_gpu_info (#13274) (#14707)

Peter0x44 committed 61 days ago

Verified d4b91ea7

Vulkan: Fix fprintf format-security warning (#14770)

0cc4m committed 61 days ago

Verified 83f58724

Documentation: Update build.md's Vulkan section (#14736)

rspOverflow committed 61 days ago

Verified f0d4d176

ggerganov committed 61 days ago

b1723091

metal : fuse add, mul + add tests (#14596)

ggerganov committed 62 days ago

Verified bf9087f5

graph : fix graph reuse reset of params (#14760)

ggerganov committed 62 days ago

Verified 9fb1042c

parallel : add option for different RNG seeds (#14757)

ggerganov committed 62 days ago

Verified 2adf8d83

cuda : Fix Gemma3n not executed as CUDA_GRAPH on NVGPUs (#14741)

ORippler committed 62 days ago

Verified 021cc28b

graph : avoid huge warm-up graphs for MoE models (#14753)

ggerganov committed 62 days ago

Verified d498af3d

model : fix build after merge conflict (#14754)

ggerganov committed 62 days ago

Verified eacdeb5b

model : add EXAONE 4.0 support (#14630)

lgai-exaone committed 62 days ago

Verified e0cb5c5c

CUDA: set_rows + cpy.cu refactor (#14712)

am17an committed 62 days ago

Verified f9a31eea

graph : refactor context to not pass gf explicitly (#14629)

ggerganov committed 62 days ago

Verified 8f974bc1

graph : Pass the graph placeholder message in debug mode (#14748)

Nexesenex committed 62 days ago

Verified 09651d09

use max work group size for device to replace the magic number (#14732)

NeoZhangJianyu committed 62 days ago

Verified 349ea79f

convert : fix Ernie4.5 MoE without shared experts (#14746)

pwilkin committed 63 days ago

Verified 670e1360

nix : use optionalAttrs for env mkDerivation attrset argument (#14726)

amozeo committed 63 days ago

Verified 760b4484

model: add Ernie 4.5 MoE support (#14658)

pwilkin committed 63 days ago

Verified cb887f1b

kv-cache : fix k-shift for multiple streams (#14742)

ggerganov committed 63 days ago

Verified d6fb3f6b

llama : reuse compute graphs (#14482)

ggerganov committed 63 days ago

Verified 01612b74

llama : fix parallel processing for lfm2 (#14705)

tdakhran committed 63 days ago

Verified 086cf81e

Newer Older