ngxson/llama.cpp

Pull Requests Commits

change to n_threads_http + 1024

ngxson committed 10 days ago

2c4e8e54

server: use httplib dynamic threads

ngxson committed 12 days ago

252540f7

ai : limit runtime of the agent (#20816)

ggerganov committed 12 days ago

Verified 4cb7e0bd

common : fix typo in debug log ('extracft' -> 'extract') (#20807)

jpohhhh committed 12 days ago

Verified 149b2493

ai : do not run bash commands in the prompt (#20810)

ggerganov committed 12 days ago

Verified b31b30f3

model : fix Granite Hybrid type check for 7B.A1B (#20795)

victor-villar committed 13 days ago

Verified 58c81f7e

server: (doc) clarify in-scope and out-scope features (#20794)

ngxson committed 13 days ago

Verified fb78ad29

vulkan: change gated_delta_net to shard a column across a subgroup (#20662)

jeffbolznv committed 13 days ago

Verified e06c3ab2

context: zero output buffer on allocation (#20781)

retr0reg committed 13 days ago

Verified dc659243

model: assert nextn_predict_layers to prevent underflow (#20783)

retr0reg committed 13 days ago

Verified 3adbef77

server : improve mtmd ctx checkpoints (#20726)

ggerganov committed 13 days ago

Verified ab9d4c36

CANN: add BF16 support for core operators (#20152)

hipudding committed 13 days ago

Verified 1af9dab3

docs : fix Metal backend op support status in ops.md (#20779)

seyoungjeong committed 13 days ago

Verified 6d99b44c

ai : update find-related action (#20790)

ggerganov committed 13 days ago

Verified 464fd0e7

jinja : fix heap OOB read in value equality comparison (#20782)

retr0reg committed 13 days ago

Verified 21c80452

common/parser : fix out_of_range crash in throw path (#20424 regression) (#20777)

jpohhhh committed 13 days ago

Verified c46583b8

server: fix router mode deadlock on child crash and TOCTOU race in models_max (#20763)

BenRacicot committed 13 days ago

Verified c1b91165

docs: Update server README to reflect PR #20297 (#20560)

Tomeamis committed 13 days ago

Verified b739738d

ggml: guard KleidiAI DOWNLOAD_EXTRACT_TIMESTAMP for cmake < 3.24 (#20767)

sundaram123krishnan committed 13 days ago

Verified a0bbcdd9

ci : improve action for duplicate issue (#20772)

ggerganov committed 13 days ago

Verified 6c72646a

hip: Avoid compiler bug in RDNA code generation during debug builds on Windows (#20655)

Exile333 committed 13 days ago

Verified 34080727

server: Add cached_tokens info to oaicompat responses (#19361)

percontation committed 13 days ago

Verified 26c9ce12

chat : handle tool calls with no required args in TAG_WITH_TAGGED format (#20764)

jpohhhh committed 13 days ago

Verified 76f2dc70

ci : clarify gh command for viewing issues (#20766)

ggerganov committed 13 days ago

Verified 900efd53

hexagon: add Matrix Extensions (HMX) for Hexagon NPU backend (#20693)

njsyw1997 committed 13 days ago

Verified 74c42ee1

ci : add hip quality check (#20430)

IMbackK committed 13 days ago

Verified b49d8b87

common/parser: add proper reasoning tag prefill reading (#20424)

pwilkin committed 13 days ago

Verified 5e54d51b

ggml webgpu: ops support for qwen3.5 (SET, TRI_SOLVE, SSM_CONV, GATED_DELTA_NET) + GET_ROWS optimization (#20687)

reeselevine committed 13 days ago

Verified c1258830

common : add LLAMA_ARG_SPEC_TYPE (#20744)

ddh0 committed 13 days ago

Verified 922b90e5

ci : add action for finding duplicate issues (#20756)

ggerganov committed 14 days ago

Verified f071ce67

Older