Pull Requests abetlen/llama-cpp-python

Better Qwen2.5-VL chat template.

#2066 opened 2025-09-07 00:04 by alcoftTAO

fix chat handler class name in README/docs

#2059 opened 2025-08-22 16:05 by anakin87

Fix multi-sequence embeddings

#2058 opened 2025-08-19 19:23 by iamlemec

Update hyperlink to llama.cpp build docs

#2056 opened 2025-08-18 12:12 by SleepyYui

Add timeout and error handling in FastAPI uvicorn server

#2044 opened 2025-07-22 10:46 by amandwivedi45

Actually create a random seed when using seed = -1 on load

#2042 opened 2025-07-16 09:00 by m-from-space

Improve error message when model file is missing

#2041 opened 2025-07-09 10:06 by NITHIN0710

ARM Runners support CUDA SBSA

#2039 opened 2025-07-07 10:45 by johnnynunez

Migrate llama.cpp submodule to ggml-org

#2034 opened 2025-06-26 11:07 by shalinib-ibm

Fix disk-cache LRU logic

#2025 opened 2025-06-03 06:43 by donbcd

Add support for Cohere Command models

#2018 opened 2025-05-12 21:45 by handshape

Flush libc stdout/stderr in suppress_stdout_stderr

#2015 opened 2025-05-07 08:12 by AuroraWright

Added support for overriding tensor buffer types

#2007 opened 2025-04-29 14:15 by zpin

Update API to match latest llama.cpp version

#1991 opened 2025-04-03 16:17 by mamei16

feat: Add Gemma3 chat handler (#1976)

#1989 opened 2025-03-30 19:54 by kossum

chore(deps): bump pypa/cibuildwheel from 2.22.0 to 2.23.2 dependencies github_actions

#1981 opened 2025-03-24 23:24 by dependabot[bot]

Initial commit

#1978 opened 2025-03-20 20:10 by Safeerchalil

fix(types): remove redundant type (typo with repeating lines)

#1971 opened 2025-03-15 16:09 by CHB-0r1s

chore(deps): update starlette-context requirement from <0.4,>=0.3.6 to >=0.3.6,<0.5 dependencies python

#1961 opened 2025-03-04 20:35 by dependabot[bot]

fix(docker): correct run.sh path in simple Dockerfile

#1911 opened 2025-01-27 13:28 by crufter

chore(deps): bump conda-incubator/setup-miniconda from 3.1.0 to 3.1.1 dependencies github_actions

#1899 opened 2025-01-20 20:54 by dependabot[bot]

feat: add streaming tool use

#1884 opened 2024-12-25 23:17 by lsorber

new

#1878 opened 2024-12-23 08:47 by Harshitha110809

Update Dockerfile

#1877 opened 2024-12-22 13:05 by Smartappli

Updated ROCm installation instructions

#1867 opened 2024-12-16 16:00 by agronholm

Add support for XTC and DRY samplers

#1843 opened 2024-11-25 17:19 by zpin

Add musa_simple Dockerfile for supporting Moore Threads GPU

#1842 opened 2024-11-25 11:17 by yeahdongcn

use n_threads param to call _embed_image_bytes fun

#1834 opened 2024-11-16 13:37 by KenForever1

Update README.md

#1825 opened 2024-11-08 02:46 by Nik-Kras

Feat: Support Ranking Method

#1820 opened 2024-11-03 04:50 by yutyan0119