ggerganov/llama.cpp

Pull Requests Commits

server : headers cleanup

ggerganov committed 37 days ago

Verified 72f80499

move enum stop_type to server-task

ngxson committed 43 days ago

625010d4

rm redundant includes

ngxson committed 43 days ago

ca993bad

add server-queue

ngxson committed 43 days ago

3b794603

add server-task, server-common

ngxson committed 43 days ago

e1a756e9

CANN: fix acl_tensor_ptr usage in ASCEND_310P ROPE (#17347)

noemotiovon committed 44 days ago

Verified bc4064cf

fix: resolve undefined variable 'svr' compilation error (#17348)

o7si committed 44 days ago

Verified 97cb3fd5

CANN: Add openEuler-cann in build and release (#17192)

xuedinge233 committed 44 days ago

Verified ffa277a5

vulkan: support noncontig i32 copy (#17328)

jeffbolznv committed 44 days ago

Verified da95bf2a

server: split HTTP into its own interface (#17216)

ngxson committed 44 days ago

Verified 0de8878c

vulkan: add log RTE support to fix Nvidia CI (#17320)

0cc4m committed 44 days ago

Verified 38e2c1b4

cmake : fix ARM feature verification (#17170)

angt committed 44 days ago

Verified cb44fc84

ggml : add missing AVX512 feature checks (#17270)

angt committed 44 days ago

Verified cb623de3

metal : support I32 -> I32 copy (#17317)

ggerganov committed 45 days ago

Verified 7aaeedc0

metal : faster argsort (#17315)

ggerganov committed 45 days ago

Verified 3347e6d9

metal : add cumsum (#17305)

ggerganov committed 45 days ago

Verified 1a139644

CANN: Use smart pointers to manage ACL objects (#17238)

hipudding committed 45 days ago

Verified 2376b775

vulkan: add LOG operation support for F32 and F16 (#17183)

zayac committed 45 days ago

Verified dbed6129

vulkan: fix MMQ quantize_y condition (#17301)

0cc4m committed 45 days ago

Verified 80deff36

ci : revert #16249 (#17303)

netrunnereve committed 45 days ago

Verified 8b1c339b

metal : remove obosolete asserts (#17295)

ggerganov committed 46 days ago

Verified 416e7c7f

server : handle context overflow during decode (#17267)

ggerganov committed 46 days ago

Verified 5b2093be

opencl: fix rms_norm_mul (#17250)

lhez committed 46 days ago

Verified 52e5d421

opencl: add kernel to handle mat mul in attention to improve encoding speed (#17181)

shaofeiqi committed 46 days ago

Verified 4db56412

sycl : unify unary kernels with a generic implementation and enable wide operator support (#17213)

shani-f committed 46 days ago

Verified 72bd7321

webui: Fix clickability around chat processing statistics UI (#17278)

allozaur committed 46 days ago

Verified 22e1ce2f

webui: add OAI-Compat Harmony tool-call streaming visualization and persistence in chat UI (#16618)

ServeurpersoCom committed 46 days ago

Verified 1411d927

convert : remove unnecessary chat template patching (#17289)

CISC committed 46 days ago

Verified 662192e1

vulkan: Fuse mul_mat_id+add_id+mul and mul_mat+add+add. (#17287)

jeffbolznv committed 46 days ago

Verified 24dc769f

vulkan: Replace 16-bit unpack8 calls to work around legacy Windows AMD driver bug (#17285)

0cc4m committed 46 days ago

Verified 4dca015b

Older