ggerganov/llama.cpp

Pull Requests Commits
github : add cmd line field to bug report (#11090)
ngxson committed 337 days ago
Verified 96be8c32
server : fix extra BOS in infill endpoint (#11106)
ggerganov committed 337 days ago
Verified e6e7c75d
llama : remove check flash_attn with lora (#11104)
ngxson committed 337 days ago
Verified 09186fab
llama : prevent system info string accumulation across calls (#11101)
a-ghorbani committed 337 days ago
Verified 96a1dc27
llama : rename missed batch params/vars to ubatch (#10059)
danbev committed 337 days ago
Verified 6369f867
llama : update llama_model API names (#11063)
ggerganov committed 337 days ago
Verified 47182dd0
tokenize : escape the prompt (#11058)
ggerganov committed 337 days ago
Verified 3e6e7a6b
mmap : fix fileno macro clash (#11076)
ggerganov committed 337 days ago
Verified ae2f606b
llama : use LLAMA_TOKEN_NULL (#11062)
ggerganov committed 337 days ago
Verified 727368c6
llama : use _impl suffix instead of _internal (#11060)
ggerganov committed 337 days ago
Verified 5047dd35
CUDA: add BF16 support (#11093)
JohannesGaessler committed 337 days ago
Verified 46e3556e
Vulkan: Add device-specific blacklist for coopmat for the AMD proprietary driver (#11074)
0cc4m committed 339 days ago
Verified b56f079e
llama : Add support for DeepSeek V3 (#11049)
fairydreaming committed 339 days ago
Verified 9394bbd4
[GGML][RPC] Support for models with non-512-aligned tensors over RPC. (#11047)
matt23654 committed 339 days ago
Verified f922a9c5
llama : add support for the cohere2 model architecture (#10900)
dranger003 committed 339 days ago
Verified 46be9422
sync : ggml
ggerganov committed 339 days ago
78c67851
ggml : do not install metal source when embed library (ggml/1054)
ggerganov committed 339 days ago
5e3b08d6
ggml : improve inputs log sched_print_assignments (ggml/1053)
danbev committed 339 days ago
db68c93b
fix: Vulkan shader gen binary path (#11037)
giladgd committed 339 days ago
Verified c31fc8b9
common : disable KV cache shifting automatically for unsupported models (#11053)
MollySophia committed 340 days ago
Verified 4b0c638b
metal : avoid uint (#11019)
ggerganov committed 340 days ago
Verified e7da954e
llama : refactor `src/llama.cpp` (#10902)
ggerganov committed 340 days ago
Verified f66f5829
server: bench: minor fixes (#10765)
phymbert committed 341 days ago
Verified 2f0ee84b
server : allow using LoRA adapters per-request (#10994)
ngxson committed 341 days ago
Verified 0da5d860
readme : add llama-swap to infrastructure section (#11032)
mostlygeek committed 341 days ago
Verified a45433ba
ggml : fixes for AVXVNNI instruction set with MSVC and Clang (#11027)
Srihari-mcw committed 343 days ago
Verified 0827b2c1
server : clean up built-in template detection (#11026)
ngxson committed 343 days ago
Verified 45095a61
server : add OAI compat for /v1/completions (#10974)
ngxson committed 343 days ago
Verified 5896c652
convert : fix Llama-3_1-Nemotron-51B rope settings (#11008)
ymcki committed 343 days ago
Verified bc7b1f86
common, examples, ggml : fix MSYS2 GCC compiler errors and warnings when building with LLAMA_CURL=ON and GGML_OPENCL=ON (#11013)
peter277 committed 343 days ago
Verified 6e1531ac
Terms Of Use Privacy Policy Refund Policy Impressum