ngxson/llama.cpp

Pull Requests Commits

Update common/chat.cpp

ngxson committed 29 days ago

Verified 6d3d5722

chat: fix int overflow, prevent size calculation in float/double

ngxson committed 29 days ago

b33603ea

CANN: fix acl_tensor_ptr usage in ASCEND_310P ROPE (#17347)

noemotiovon committed 29 days ago

Verified bc4064cf

fix: resolve undefined variable 'svr' compilation error (#17348)

o7si committed 29 days ago

Verified 97cb3fd5

CANN: Add openEuler-cann in build and release (#17192)

xuedinge233 committed 29 days ago

Verified ffa277a5

vulkan: support noncontig i32 copy (#17328)

jeffbolznv committed 29 days ago

Verified da95bf2a

server: split HTTP into its own interface (#17216)

ngxson committed 29 days ago

Verified 0de8878c

vulkan: add log RTE support to fix Nvidia CI (#17320)

0cc4m committed 29 days ago

Verified 38e2c1b4

cmake : fix ARM feature verification (#17170)

angt committed 29 days ago

Verified cb44fc84

ggml : add missing AVX512 feature checks (#17270)

angt committed 30 days ago

Verified cb623de3

metal : support I32 -> I32 copy (#17317)

ggerganov committed 30 days ago

Verified 7aaeedc0

metal : faster argsort (#17315)

ggerganov committed 30 days ago

Verified 3347e6d9

metal : add cumsum (#17305)

ggerganov committed 30 days ago

Verified 1a139644

CANN: Use smart pointers to manage ACL objects (#17238)

hipudding committed 30 days ago

Verified 2376b775

vulkan: add LOG operation support for F32 and F16 (#17183)

zayac committed 30 days ago

Verified dbed6129

vulkan: fix MMQ quantize_y condition (#17301)

0cc4m committed 30 days ago

Verified 80deff36

ci : revert #16249 (#17303)

netrunnereve committed 30 days ago

Verified 8b1c339b

metal : remove obosolete asserts (#17295)

ggerganov committed 31 days ago

Verified 416e7c7f

server : handle context overflow during decode (#17267)

ggerganov committed 31 days ago

Verified 5b2093be

opencl: fix rms_norm_mul (#17250)

lhez committed 31 days ago

Verified 52e5d421

opencl: add kernel to handle mat mul in attention to improve encoding speed (#17181)

shaofeiqi committed 31 days ago

Verified 4db56412

sycl : unify unary kernels with a generic implementation and enable wide operator support (#17213)

shani-f committed 31 days ago

Verified 72bd7321

webui: Fix clickability around chat processing statistics UI (#17278)

allozaur committed 31 days ago

Verified 22e1ce2f

webui: add OAI-Compat Harmony tool-call streaming visualization and persistence in chat UI (#16618)

ServeurpersoCom committed 31 days ago

Verified 1411d927

convert : remove unnecessary chat template patching (#17289)

CISC committed 31 days ago

Verified 662192e1

vulkan: Fuse mul_mat_id+add_id+mul and mul_mat+add+add. (#17287)

jeffbolznv committed 31 days ago

Verified 24dc769f

vulkan: Replace 16-bit unpack8 calls to work around legacy Windows AMD driver bug (#17285)

0cc4m committed 32 days ago

Verified 4dca015b

convert : use all parts in safetensors index (#17286)

CISC committed 32 days ago

Verified 9a8860cf

convert : set expert gating func in base class (#17279)

CISC committed 32 days ago

Verified 9d3ef480

mtmd-cli: Avoid logging to stdout for model loading messages in mtmd-cli (#17277)

ankurvdev committed 32 days ago

Verified c7b7db04

Older