ngxson/llama.cpp

Pull Requests Commits

remove built-in cpp chat template

ngxson committed 75 days ago

92164cf3

pad only the final value of plan.n_kv to 256

sszymczy committed 77 days ago

9a0afa8a

add padding to enable FA

am17an committed 77 days ago

addcfca7

address review comments

am17an committed 77 days ago

2b2be697

revert max split inputs

am17an committed 77 days ago

61111c05

reserve worst-case kv-cache

am17an committed 78 days ago

9adebc2a

simplified set_gguf_parameters() by calling super class method, replaced moe.score_func with expert_gating_func.

sszymczy committed 78 days ago

965ce3a8

compatibility with antirez ds4 GGUFs

sszymczy committed 78 days ago

76842dc8

am17an committed 81 days ago

6323d934

fix test llama archs

am17an committed 81 days ago

8d9f8823

am17an committed 81 days ago

e5865927

enable graph reuse

am17an committed 81 days ago

c50f5809

s/deepseek-v4-flash/deepseek4/g continued

sszymczy committed 81 days ago

c7f775af

s/deepseek-v4-flash/deepseek4/g

am17an committed 81 days ago

6fe4b55d

Add mechanism for inlining templates based on architecture

pwilkin committed 81 days ago

ff0795e7

remove debugging leftovers

sszymczy committed 81 days ago

30588c15

pwilkin committed 81 days ago

6a5f579b

remove redundant V cache

am17an committed 81 days ago

9ecebb4a

support pro model: added by @fairydreaming

am17an committed 81 days ago

a93b09eb

am17an committed 81 days ago

d1ad0ba6

cleanup dead code

am17an committed 81 days ago

045c9761

am17an committed 81 days ago

e1ac0292

add sinkhorn eps - correction by @fairydreaming

am17an committed 81 days ago

7c746295

add save-load state

am17an committed 81 days ago

4f7836c8

add llm_graph_input_dsv4

am17an committed 81 days ago

7aad89c6

add basic setup

am17an committed 81 days ago

b90b7896

convert: add dsv4 conversion

am17an committed 81 days ago

b9d20184

server : fix reasoning budget WebUI precedence over model.ini (#24517)

ggerganov committed 81 days ago

Verified ebc10770

vulkan: add pipeline barriers for memcpy read operations (#23770)

0cc4m committed 81 days ago

Verified 3e7bd4f3

ui: PWA support (#23871)

allozaur committed 81 days ago

Verified f7ca93d1

Older