ggml-org/llama.cpp

Pull Requests Commits
jinja : Add Mistral-Small-3.2-24B-Instruct-2506.jinja (#14349)
bartowski1182 committed 1 year ago
Verified 901e20bb
CUDA/HIP: optimize mmv paths taken for HIP devices (#14324)
IMbackK committed 1 year ago
Verified 0142961a
ci: add workflow for relocatable cmake package (#14346)
mtmcp committed 1 year ago
Verified ce82bd01
vulkan: update windows SDK in release.yml (#14344)
jeffbolznv committed 1 year ago
Verified bf2a99e3
llama : better rwkv chat template and add missing `inputs.use_jinja` setting (#14336)
MollySophia committed 1 year ago
Verified 72c6bc3f
CUDA: mul_mat_v support for batch sizes > 1 (#14262)
JohannesGaessler committed 1 year ago
Verified defe2158
kv-cells : fix tracking of seq_pos (#14339)
ggerganov committed 1 year ago
Verified 7b50d589
vulkan: update windows SDK in CI (#14334)
jeffbolznv committed 1 year ago
Verified 3a9457df
quantize : handle user-defined pruning of whole layers (blocks) (#13037)
EAddario committed 1 year ago
Verified fa4a9f2a
gguf-py : fix SpecialVocab parsing when post_processor is null (#14330)
CISC committed 1 year ago
Verified 238005c2
run : avoid double tokenization (#14327)
retr0reg committed 1 year ago
Verified 66aba7ac
examples : fix is_first logic for tokenization (#14329)
ggerganov committed 1 year ago
Verified f1f5e82d
HIP: enable vec fattn on RDNA4 (#14323)
IMbackK committed 1 year ago
Verified af3373f1
mtmd : fix Pixtral OOM with large images by capping image_size to 1024 (#14326)
yuiseki committed 1 year ago
Verified 5d5c066d
common : use std::string_view now that we target c++17 (#14319)
CISC committed 1 year ago
Verified 40bfa04c
CUDA: add mean operation (#14313)
am17an committed 1 year ago
Verified aa064b2e
gguf-py : fix Qwen3-Embedding eos token (#14314)
CISC committed 1 year ago
Verified aa0ef5c5
Add support for VK_EXT_debug_utils to add labels to Vulkan objects. (#13792)
mtavenrath committed 1 year ago
Verified bb16041c
gguf-py : fix TemplateProcessing pair when bos/eos is missing (#14312)
CISC committed 1 year ago
Verified 58cba76a
metal : fix thread-safety (#14300)
ggerganov committed 1 year ago
Verified 67ae5312
memory : rename interface to llama_memory_context_i (#14296)
ggerganov committed 1 year ago
Verified 692e3cdd
convert : fix Llama 4 conversion (#14311)
danielhanchen committed 1 year ago
Verified b23fa0b3
sync : ggml
ggerganov committed 1 year ago
06cbedfc
Add `ggml_roll` (ggml/1274)
Acly committed 1 year ago
b7147673
docs : fix the link to llama.h (#14293)
david20571015 committed 1 year ago
Verified d860dd99
CUDA: add conv_2d_transpose (#14287)
am17an committed 1 year ago
Verified c959f462
lint : remove trailing whitepace (#14304)
CISC committed 1 year ago
Verified 22015b20
vocab : prevent tokenizer overflow (#14301)
retr0reg committed 1 year ago
Verified dd6e6d0b
sycl: add usage of enqueue_functions extension (#14244)
s-Nick committed 1 year ago
Verified 8308f98c
Implement GGML_CPU_ALL_VARIANTS for PowerPC (#14286)
ckastner committed 1 year ago
Verified 6369be07
Terms Of Use Privacy Policy Refund Policy Impressum