ngxson/llama.cpp

Pull Requests Commits

correct rope_theta

ngxson committed 81 days ago

c2355465

make sure to use rope_yarn_log_mul

ngxson committed 88 days ago

bf4ef6de

update conversion script

ngxson committed 88 days ago

13369dda

Merge branch 'master' into xsn/llama4_scaling

ngxson committed 88 days ago

0e52ba2b

vulkan: add log RTE support to fix Nvidia CI (#17320)

0cc4m committed 88 days ago

Verified 38e2c1b4

cmake : fix ARM feature verification (#17170)

angt committed 88 days ago

Verified cb44fc84

ggml : add missing AVX512 feature checks (#17270)

angt committed 89 days ago

Verified cb623de3

metal : support I32 -> I32 copy (#17317)

ggerganov committed 89 days ago

Verified 7aaeedc0

metal : faster argsort (#17315)

ggerganov committed 89 days ago

Verified 3347e6d9

metal : add cumsum (#17305)

ggerganov committed 89 days ago

Verified 1a139644

CANN: Use smart pointers to manage ACL objects (#17238)

hipudding committed 89 days ago

Verified 2376b775

vulkan: add LOG operation support for F32 and F16 (#17183)

zayac committed 89 days ago

Verified dbed6129

vulkan: fix MMQ quantize_y condition (#17301)

0cc4m committed 89 days ago

Verified 80deff36

ci : revert #16249 (#17303)

netrunnereve committed 89 days ago

Verified 8b1c339b

metal : remove obosolete asserts (#17295)

ggerganov committed 90 days ago

Verified 416e7c7f

server : handle context overflow during decode (#17267)

ggerganov committed 90 days ago

Verified 5b2093be

opencl: fix rms_norm_mul (#17250)

lhez committed 90 days ago

Verified 52e5d421

opencl: add kernel to handle mat mul in attention to improve encoding speed (#17181)

shaofeiqi committed 90 days ago

Verified 4db56412

sycl : unify unary kernels with a generic implementation and enable wide operator support (#17213)

shani-f committed 90 days ago

Verified 72bd7321

webui: Fix clickability around chat processing statistics UI (#17278)

allozaur committed 90 days ago

Verified 22e1ce2f

webui: add OAI-Compat Harmony tool-call streaming visualization and persistence in chat UI (#16618)

ServeurpersoCom committed 90 days ago

Verified 1411d927

convert : remove unnecessary chat template patching (#17289)

CISC committed 90 days ago

Verified 662192e1

vulkan: Fuse mul_mat_id+add_id+mul and mul_mat+add+add. (#17287)

jeffbolznv committed 90 days ago

Verified 24dc769f

vulkan: Replace 16-bit unpack8 calls to work around legacy Windows AMD driver bug (#17285)

0cc4m committed 90 days ago

Verified 4dca015b

convert : use all parts in safetensors index (#17286)

CISC committed 90 days ago

Verified 9a8860cf

convert : set expert gating func in base class (#17279)

CISC committed 90 days ago

Verified 9d3ef480

mtmd-cli: Avoid logging to stdout for model loading messages in mtmd-cli (#17277)

ankurvdev committed 91 days ago

Verified c7b7db04

vulkan: implement ABS and NEG (#17245)

giuseppe committed 91 days ago

Verified 1568d13c

vulkan: Use ggml_vk_tensor_subbuffer in mul_mat_vec(id) paths (#17244)

jeffbolznv committed 91 days ago

Verified 439342ea

vulkan: skip all-negative-inf blocks in FA (#17186)

jeffbolznv committed 91 days ago

Verified 234ae7d7

Older