ngxson/llama.cpp

Pull Requests Commits

vulkan: Add copy_transpose shader (#17371)

jeffbolznv committed 106 days ago

Verified 2eba631b

webui: Add a "Continue" Action for Assistant Message (#16971)

allozaur committed 106 days ago

Verified 99c53d65

convert : use self.block_count everywhere instead of reading hparams (#17359)

CISC committed 106 days ago

Verified 07b0e7a5

cuda: fix rope fusion for gemma3 (#17378)

am17an committed 106 days ago

Verified fd7353d5

Fix too relaxed check on CUDA "fast copy" (can_be_transposed) condition (#17332)

pwilkin committed 106 days ago

Verified 6fd4f953

vulkan: force full subgroups for flash attention to fix intel subgroup crash (#17356)

0cc4m committed 106 days ago

Verified 980b7cd1

ggml-cpu: Don't pass -mpowerpc64 when -mcpu already implies it (#17308)

JeremyRand committed 107 days ago

Verified c49daff5

chat: fix int overflow, prevent size calculation in float/double (#17357)

ngxson committed 107 days ago

Verified 10e97801

vocab : call reserve() for building plamo-2-translate suffix (#17343)

haiyuewa committed 107 days ago

Verified a0454920

common : Generalized XML-style tool-call parsing with streaming support (GLM 4.5/4.6 + MiniMax M2 + SeedOSS + Kimi-K2 + Qwen3-Coder + Apriel-1.5 + Xiaomi-MiMo) (#16932)

hksdpc255 committed 107 days ago

Verified 1920345c

ci : change the openEuler-310p image to fix release (#17361)

xuedinge233 committed 107 days ago

Verified 561a3e27

gitignore : be more specific about ignored stuff (#17354)

ggerganov committed 107 days ago

Verified f40a2e5f

CANN: fix acl_tensor_ptr usage in ASCEND_310P ROPE (#17347)

noemotiovon committed 107 days ago

Verified bc4064cf

fix: resolve undefined variable 'svr' compilation error (#17348)

o7si committed 107 days ago

Verified 97cb3fd5

CANN: Add openEuler-cann in build and release (#17192)

xuedinge233 committed 107 days ago

Verified ffa277a5

vulkan: support noncontig i32 copy (#17328)

jeffbolznv committed 108 days ago

Verified da95bf2a

server: split HTTP into its own interface (#17216)

ngxson committed 108 days ago

Verified 0de8878c

vulkan: add log RTE support to fix Nvidia CI (#17320)

0cc4m committed 108 days ago

Verified 38e2c1b4

cmake : fix ARM feature verification (#17170)

angt committed 108 days ago

Verified cb44fc84

ggml : add missing AVX512 feature checks (#17270)

angt committed 108 days ago

Verified cb623de3

metal : support I32 -> I32 copy (#17317)

ggerganov committed 108 days ago

Verified 7aaeedc0

metal : faster argsort (#17315)

ggerganov committed 108 days ago

Verified 3347e6d9

metal : add cumsum (#17305)

ggerganov committed 108 days ago

Verified 1a139644

CANN: Use smart pointers to manage ACL objects (#17238)

hipudding committed 109 days ago

Verified 2376b775

vulkan: add LOG operation support for F32 and F16 (#17183)

zayac committed 109 days ago

Verified dbed6129

vulkan: fix MMQ quantize_y condition (#17301)

0cc4m committed 109 days ago

Verified 80deff36

ci : revert #16249 (#17303)

netrunnereve committed 109 days ago

Verified 8b1c339b

metal : remove obosolete asserts (#17295)

ggerganov committed 109 days ago

Verified 416e7c7f

server : handle context overflow during decode (#17267)

ggerganov committed 110 days ago

Verified 5b2093be

opencl: fix rms_norm_mul (#17250)

lhez committed 110 days ago

Verified 52e5d421

Newer Older