ggerganov/llama.cpp

Pull Requests Commits

ggerganov committed 358 days ago

Verified 3e92f4ec

unicode : improve naming style

ggerganov committed 358 days ago

Verified 7a20c287

server: Fix `has_next_line` in JSON response (#10818)

MichelleTanPY committed 358 days ago

Verified 89d604f2

nix: allow to override rocm gpu targets (#10794)

kurnevsky committed 359 days ago

Verified e52aba53

llama : add Qwen2VL support + multimodal RoPE (#10361)

HimariO committed 359 days ago

Verified ba1cb19c

Removes spurious \r in output that causes logging in journalctl to treat lines as binary and therefore hidden by default (#10771)

cduk committed 359 days ago

Verified 56eea078

Introducing experimental OpenCL backend with support for Qualcomm Adreno GPUs (#10693)

lhez committed 360 days ago

Verified a76c56fa

Opt class for positional argument handling (#10508)

ericcurtin committed 360 days ago

Verified c27ac678

fix: graceful shutdown for Docker images (#10815)

co42 committed 360 days ago

Verified 11e07fd6

gguf-py : numpy 2 newbyteorder fix (#9772)

jettjaniak committed 360 days ago

Verified 4601a8bb

Fix crash caused by ggml_backend_load_all when launching on Android Activity (#10812)

sienaiwun committed 360 days ago

Verified 9f35e445

vulkan: small mul_mat_vec optimizations (#10665)

netrunnereve committed 360 days ago

Verified 64ae0655

SYCL: Reduce most of the compiler warnings (#10748)

qnixsynapse committed 360 days ago

Verified 83ed24a9

ggml : Fix compilation issues on ARM platform when building without fp16 (#10811)

kkontny committed 360 days ago

Verified d583cd03

common : improve -ctv -ctk CLI arguments (#10806)

ngxson committed 360 days ago

Verified adffa6ff

contrib : add ngxson as codeowner (#10804)

ngxson committed 361 days ago

Verified 274ec65a

CUDA: faster non-contiguous concat (#10760)

A3shTnT committed 361 days ago

Verified 8faa1d4d

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

slaren committed 361 days ago

Verified cb13ef85

Vulkan: Use improved q4_k and q5_k dequant code in dequant shaders (#10798)

0cc4m committed 361 days ago

Verified 4064c0e3

Vulkan: Add VK_EXT_subgroup_size_control support to ensure full subgroups for coopmats (#10721)

0cc4m committed 361 days ago

Verified dc5301d5

common : add missing env var for speculative (#10801)

ngxson committed 361 days ago

Verified 9fdb1243

docs: update server streaming mode documentation (#9519)

CentricStorm committed 361 days ago

Verified 5555c0c1

Merge pull request #10788 from ggerganov/gg/gguf-py-0.11.0

ggerganov committed 361 days ago

Verified 973f328b

gguf-py : bump version to 0.11.0

ggerganov committed 361 days ago

Verified fb18934a

server : (UI) add tok/s, get rid of completion.js (#10786)

ngxson committed 362 days ago

Verified 235f6e14

Update README.md (#10772)

qingy1337 committed 362 days ago

Verified 1a31d0dc

ci : pin nodejs to 22.11.0 (#10779)

ngxson committed 362 days ago

Verified 92f77a64

bug-fix: snprintf prints NULL in place of the last character (#10419)

kallewoof committed 362 days ago

Verified 484d2f31

docs: fix server documentation formatting (#10776)

CentricStorm committed 362 days ago

Verified 4b4d92b0

ggml: load all backends from a user-provided search path (#10699)

giladgd committed 362 days ago

Verified 43041d2e

Older