ngxson/llama.cpp

Pull Requests Commits

arg: slightly reduce compilation time

ngxson committed 29 days ago

0661161b

vulkan: Replace 16-bit unpack8 calls to work around legacy Windows AMD driver bug (#17285)

0cc4m committed 31 days ago

Verified 4dca015b

convert : use all parts in safetensors index (#17286)

CISC committed 31 days ago

Verified 9a8860cf

convert : set expert gating func in base class (#17279)

CISC committed 31 days ago

Verified 9d3ef480

mtmd-cli: Avoid logging to stdout for model loading messages in mtmd-cli (#17277)

ankurvdev committed 31 days ago

Verified c7b7db04

vulkan: implement ABS and NEG (#17245)

giuseppe committed 31 days ago

Verified 1568d13c

vulkan: Use ggml_vk_tensor_subbuffer in mul_mat_vec(id) paths (#17244)

jeffbolznv committed 31 days ago

Verified 439342ea

vulkan: skip all-negative-inf blocks in FA (#17186)

jeffbolznv committed 32 days ago

Verified 234ae7d7

vulkan: change graph_compute to be async and enable get_tensor_async (#17158)

jeffbolznv committed 32 days ago

Verified 38eaf32a

mtmd: add mtmd_log_set (#17268)

ngxson committed 32 days ago

Verified 9b17d74a

model : add AfmoeForCausalLM support (#16477)

bartowski1182 committed 32 days ago

Verified e1fcf8b0

fix : Dangling pointer for non-empty trigger words in lazy grammar construction (#17048)

marek-hradil committed 32 days ago

Verified 6cd0cf72

server : fix "can batch with" bug (#17263)

ggerganov committed 32 days ago

Verified d396b437

metal : support argsort for ne00 > 1024 (#17247)

ggerganov committed 33 days ago

Verified 45c6ef73

metal : make the FA extra sizes consistent (#17143)

ggerganov committed 33 days ago

Verified 2606b0ad

readme : add RVV,ZVFH,ZFH,ZICBOP support for RISC-V (#17259)

ixgbe committed 33 days ago

Verified 307772fc

Better UX for handling multiple attachments in WebUI (#17246)

allozaur committed 33 days ago

Verified f1bad23f

ggml-cpu: handle 3d tensors in repack mat_mul (#17241)

Alcpz committed 33 days ago

Verified becc4816

server: fixing naming conflict res_error (#17243)

ngxson committed 33 days ago

Verified c4abcb24

ggml : add ops SOFTPLUS, EXPM1, TRI, SOLVE_TRI, CUMSUM (#17063)

pwilkin committed 33 days ago

Verified 389ac78b

vulkan: remove shell call from vulkan-shaders-gen tool, revert file check (#17219)

0cc4m committed 33 days ago

Verified a19bd6f7

sched : fix reserve ignoring user tensor assignments (#17232)

slaren committed 33 days ago

Verified dd091e52

ggml-cpu : add RISC-V vector intrinsic support for silu and cvar operations (#17227)

ixgbe committed 33 days ago

Verified 1215dde7

metal: accelerated conv2d (#17175)

bghira committed 33 days ago

Verified 0cfb1916

Revert "ggml-cpu: handle 3d tensors in repack mat_mul (#17030)" (#17233)

ggerganov committed 33 days ago

Verified 2776db6c

ggml-cpu : use template for argsort (#17222)

slaren committed 34 days ago

Verified 879dec34

CANN: Add cross_entropy_loss op support (#16886)

TecJesh committed 34 days ago

Verified 97d51172

CUDA: fuse rope + set_rows (#16884)

am17an committed 34 days ago

Verified a90eb94c

update SYCL support OPs (#17208)

NeoZhangJianyu committed 34 days ago

Verified 07751f8d

vocab : correct bounds check for UGM XCDA array access (#17215)

o7si committed 34 days ago

Verified ffb6f3d9

Older