ngxson/llama.cpp

Pull Requests Commits

Revert "vulkan: force full subgroups for flash attention to fix intel subgroup crash (#17356)" (#18831)

rillomas committed 6 days ago

Verified 067b8d7a

vulkan: Use mul_mat_vec_id for small values of n (#18918)

jeffbolznv committed 6 days ago

Verified 50b7f076

memory : add llama_memory_hybrid_iswa (#18601)

tdakhran committed 6 days ago

Verified ad8d85bd

Fix GLM 4.7 Lite MoE gating func (#18980)

pwilkin committed 6 days ago

Verified 12a4a47e

gguf: display strerrno when cant load a model (#18884)

teto committed 6 days ago

Verified 37c35f0e

CUDA: Fix builds for older CCCL versions by ifdefing strided_iterator (#18964)

ORippler committed 7 days ago

Verified 5bd341c9

common, server : use the same User-Agent by default (#18957)

angt committed 7 days ago

Verified 1c7cf94b

cli : fix reasoning responses in CLI (#18961)

ngxson committed 7 days ago

Verified 2c1f1996

CUDA: Replace init_offsets kernel with iterators in cub-based argsort (#18930)

ORippler committed 7 days ago

Verified d1e35564

ggml : cleanup path_str() (#18928)

angt committed 7 days ago

Verified 08f3f4a8

metal : enable FA for MLA heads (#18950)

ggerganov committed 7 days ago

Verified 27119190

convert : use n_groups instead of hardcoded values in reshape (#18929)

danbev committed 7 days ago

Verified 7dee9ff5

server : refactor oai_parser_opt, move it to server_chat_params (#18937)

ngxson committed 8 days ago

Verified 6df686be

convert : support Glm4MoeLite (#18936)

ddh0 committed 8 days ago

Verified 1706a6d7

jinja : fix undefined keys and attributes and int/float as bool (#18924)

CISC committed 8 days ago

Verified 959ecf7f

ci : run test-jinja -py on high perf [no ci] (#18916)

CISC committed 8 days ago

Verified 4037093c

server: fix memory reservations in populate_token_probs (#18787)

l-austenfeld committed 8 days ago

Verified 18361c57

ggml : add ggml_build_forward_select (#18550)

ggerganov committed 8 days ago

Verified 365a3e8c

model-conversion : add BUILD_DIR variable to run-converted-model scripts (#18927)

danbev committed 8 days ago

Verified 3d55846a

llama : Extend fallback, fix fileno for dio file, exclude case that mmap uses dio file (#18887)

JTischbein committed 9 days ago

Verified 287a3301

docs: add linux to index (#18907)

alosslessdev committed 9 days ago

Verified 293a1565

tests : add test-jinja -py option for cross-checking (#18906)

ngxson committed 9 days ago

Verified fe44d355

jinja : fix object item order (and properly implement dictsort) (#18904)

CISC committed 9 days ago

Verified bbcdac01

jinja : attribute support for join, map and sort (#18883)

CISC committed 9 days ago

Verified d03c45c9

jinja : add missing tojson filter for bool (#18900)

CISC committed 10 days ago

Verified 10c98cbd

jinja : fix lexing of float literals with sign (#18901)

CISC committed 10 days ago

Verified 420960ab

jinja: correct member access rule (#18905)

ngxson committed 10 days ago

Verified f55b033a

opencl: fix q6_K mv for m=1 (#18893)

lhez committed 10 days ago

Verified d1b4757d

ci : add label for jinja changes (#18903)

CISC committed 10 days ago

Verified 57c0beae

kv-cache : optimize KQ mask construction (#18842)

ggerganov committed 10 days ago

Verified 2fbde785

Newer Older