ggerganov/llama.cpp

Pull Requests Commits

remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)

slaren committed 327 days ago

Verified cb13ef85

Vulkan: Use improved q4_k and q5_k dequant code in dequant shaders (#10798)

0cc4m committed 327 days ago

Verified 4064c0e3

Vulkan: Add VK_EXT_subgroup_size_control support to ensure full subgroups for coopmats (#10721)

0cc4m committed 327 days ago

Verified dc5301d5

common : add missing env var for speculative (#10801)

ngxson committed 327 days ago

Verified 9fdb1243

docs: update server streaming mode documentation (#9519)

CentricStorm committed 328 days ago

Verified 5555c0c1

Merge pull request #10788 from ggerganov/gg/gguf-py-0.11.0

ggerganov committed 328 days ago

Verified 973f328b

gguf-py : bump version to 0.11.0

ggerganov committed 328 days ago

Verified fb18934a

server : (UI) add tok/s, get rid of completion.js (#10786)

ngxson committed 328 days ago

Verified 235f6e14

Update README.md (#10772)

qingy1337 committed 328 days ago

Verified 1a31d0dc

ci : pin nodejs to 22.11.0 (#10779)

ngxson committed 328 days ago

Verified 92f77a64

bug-fix: snprintf prints NULL in place of the last character (#10419)

kallewoof committed 328 days ago

Verified 484d2f31

docs: fix server documentation formatting (#10776)

CentricStorm committed 329 days ago

Verified 4b4d92b0

ggml: load all backends from a user-provided search path (#10699)

giladgd committed 329 days ago

Verified 43041d2e

vulkan: request round-to-even for fp16 in im2col/rope_head (#10767)

jeffbolznv committed 329 days ago

Verified b685daf3

vulkan: dynamic subgroup size for the remaining k quants (#10745)

netrunnereve committed 329 days ago

Verified dafae66c

imatrix : Add imatrix to --no-context-shift (#10766)

bartowski1182 committed 329 days ago

Verified ae4b9226

CUDA: rename macros to avoid conflicts with WinAPI (#10736)

aendk committed 329 days ago

Verified 750cb3e2

server : add flag to disable the web-ui (#10762) (#10751)

eugeniosegala committed 329 days ago

Verified a86ad841

vulkan: disable spirv-opt for coopmat shaders (#10763)

jeffbolznv committed 329 days ago

Verified a05e2afc

CUDA: fix shared memory access condition for mmv (#10740)

JohannesGaessler committed 330 days ago

Verified 26a8406b

Changes to CMakePresets.json to add ninja clang target on windows (#10668)

Srihari-mcw committed 330 days ago

Verified c37fb4cf

vulkan: fix compile warnings (#10731)

jeffbolznv committed 331 days ago

Verified 3d98b4cb

cmake : simplify msvc charsets (#10672)

iboB committed 331 days ago

Verified 1a050047

server : fix format_infill (#10724)

ngxson committed 331 days ago

Verified ce8784bd

server : bring back info of final chunk in stream mode (#10722)

ngxson committed 331 days ago

Verified e52522b8

Vulkan: fix NaN in tanh.comp with AMD proprietary driver on Windows (#10723)

stduhpf committed 331 days ago

Verified 06d70147

llama : use cmake for swift build (#10525)

slaren committed 331 days ago

Verified 43ed389a

vulkan: compile a test shader in cmake to check for coopmat2 support (#10713)

jeffbolznv committed 332 days ago

Verified ecc93d05

llama : add 128k yarn context for Qwen (#10698)

robbiemu committed 332 days ago

Verified 62e84d98

server : (refactor) no more json in server_task input (#10691)

ngxson committed 332 days ago

Verified 3573fa8e

Newer Older