ngxson/llama.cpp

Pull Requests Commits

ngxson committed 13 hours ago

ef498290

move utils to class member

ngxson committed 13 hours ago

475bce81

ngxson committed 18 hours ago

08637d65

add tools_io_basic

ngxson committed 18 hours ago

497d8c0a

add tools_io abstraction

ngxson committed 19 hours ago

dc2d97b5

improve edit tool

ngxson committed 19 hours ago

4eccb1cd

server: improve tools, remove apply_diff

ngxson committed 19 hours ago

918033f7

meta: add hard emphasis on agents not writing descriptions/comments (#25480)

pwilkin committed 22 hours ago

Verified c15c5c77

Refactor: Consistently use smart pointers in `test-backend-ops` (#25440)

ORippler committed 22 hours ago

Verified f84a5194

Only index by compile times + always multiply/add (#25445)

ORippler committed 1 day ago

Verified 683f0c72

llama-bench : init params.offline (#25476)

angt committed 1 day ago

Verified 259f2e2a

metal : add CONV_2D_DW (depthwise convolution) support (#21565)

Sou-ly committed 1 day ago

Verified 92b187c9

ggml-hip: enable -funsafe-math-optimizations (#24668)

RapidMark committed 1 day ago

Verified ccb0c342

cuda: align snake fusion matcher with the other backends (#25460)

ServeurpersoCom committed 1 day ago

Verified 2021515a

server : respect min-step when splitting prompt batches (#25420)

aldehir committed 1 day ago

Verified 64c8b7db

hexagon: add VISION RoPE support (#25216)

aparmp-quic committed 1 day ago

Verified f2d1c2f3

ggml-webgpu: tune subgroup split (d_split) in flash_attn_vec (#25418)

yomaytk committed 1 day ago

Verified 32e41fa5

opencl: Q6_K GEMM/GEMV fix for ne01 of weights that are not multiples of 128. (#25464)

wanghqc committed 1 day ago

Verified 92366df3

vulkan: disable FA mask_opt on GCN to improve performance (#24362)

0cc4m committed 1 day ago

Verified a646006f

opencl: ragged-tile MoE prefill FP16 GEMM optimization (skip padded expert tiles) (#25433)

wanghqc committed 1 day ago

Verified 167d0576

llama-batch: fix allowed decreasing pos in a seq (#25449)

am17an committed 1 day ago

Verified 1ee09393

vulkan: for small AMD GPUs, reduce submission threshold based on CU count (#25240)

0cc4m committed 1 day ago

Verified 0bbc87b1

hexagon: new vtcm layouts and improved pipelines for MUL_MAT, MUL_MAT_ID and FLASH_ATTN_EXT (#25425)

max-krasnyansky committed 1 day ago

Verified 81ff7abe

cli : move to HTTP-based implementation (#24948)

ngxson committed 1 day ago

Verified c264f65f

Make hip quality check run on all changes (#25403)

ORippler committed 1 day ago

Verified 07e012af

cuda : add support for f16->f16 GGML_OP_SET_ROWS (#25367)

fairydreaming committed 2 days ago

Verified ed8c2615

llama: refactor fused ops (#24646)

am17an committed 2 days ago

Verified 90e0f5cf

server-stream: follow-up on SSE Replay Buffer (#23226) (#25047)

ServeurpersoCom committed 2 days ago

Verified bbebeec4

llama-batch: add n_keep_tail in split_equal for recurrent models (#25278)

am17an committed 2 days ago

Verified 230ea9d2

common: auto-create prompts-log-dir at argument parsing, so all tools using the flag benefit (#25322)

rankaiyx committed 2 days ago

Verified f296fdfb

Older