ggerganov/llama.cpp

Pull Requests Commits

releases : disable s390x builds

ggerganov committed 71 days ago

Verified 203eec25

common : fix typo in debug log ('extracft' -> 'extract') (#20807)

jpohhhh committed 71 days ago

Verified 149b2493

ai : do not run bash commands in the prompt (#20810)

ggerganov committed 71 days ago

Verified b31b30f3

model : fix Granite Hybrid type check for 7B.A1B (#20795)

victor-villar committed 71 days ago

Verified 58c81f7e

server: (doc) clarify in-scope and out-scope features (#20794)

ngxson committed 71 days ago

Verified fb78ad29

vulkan: change gated_delta_net to shard a column across a subgroup (#20662)

jeffbolznv committed 72 days ago

Verified e06c3ab2

context: zero output buffer on allocation (#20781)

retr0reg committed 72 days ago

Verified dc659243

model: assert nextn_predict_layers to prevent underflow (#20783)

retr0reg committed 72 days ago

Verified 3adbef77

server : improve mtmd ctx checkpoints (#20726)

ggerganov committed 72 days ago

Verified ab9d4c36

CANN: add BF16 support for core operators (#20152)

hipudding committed 72 days ago

Verified 1af9dab3

docs : fix Metal backend op support status in ops.md (#20779)

seyoungjeong committed 72 days ago

Verified 6d99b44c

ai : update find-related action (#20790)

ggerganov committed 72 days ago

Verified 464fd0e7

jinja : fix heap OOB read in value equality comparison (#20782)

retr0reg committed 72 days ago

Verified 21c80452

common/parser : fix out_of_range crash in throw path (#20424 regression) (#20777)

jpohhhh committed 72 days ago

Verified c46583b8

server: fix router mode deadlock on child crash and TOCTOU race in models_max (#20763)

BenRacicot committed 72 days ago

Verified c1b91165

docs: Update server README to reflect PR #20297 (#20560)

Tomeamis committed 72 days ago

Verified b739738d

ggml: guard KleidiAI DOWNLOAD_EXTRACT_TIMESTAMP for cmake < 3.24 (#20767)

sundaram123krishnan committed 72 days ago

Verified a0bbcdd9

ci : improve action for duplicate issue (#20772)

ggerganov committed 72 days ago

Verified 6c72646a

hip: Avoid compiler bug in RDNA code generation during debug builds on Windows (#20655)

Exile333 committed 72 days ago

Verified 34080727

server: Add cached_tokens info to oaicompat responses (#19361)

percontation committed 72 days ago

Verified 26c9ce12

chat : handle tool calls with no required args in TAG_WITH_TAGGED format (#20764)

jpohhhh committed 72 days ago

Verified 76f2dc70

ci : clarify gh command for viewing issues (#20766)

ggerganov committed 72 days ago

Verified 900efd53

hexagon: add Matrix Extensions (HMX) for Hexagon NPU backend (#20693)

njsyw1997 committed 72 days ago

Verified 74c42ee1

ci : add hip quality check (#20430)

IMbackK committed 72 days ago

Verified b49d8b87

common/parser: add proper reasoning tag prefill reading (#20424)

pwilkin committed 72 days ago

Verified 5e54d51b

ggml webgpu: ops support for qwen3.5 (SET, TRI_SOLVE, SSM_CONV, GATED_DELTA_NET) + GET_ROWS optimization (#20687)

reeselevine committed 72 days ago

Verified c1258830

common : add LLAMA_ARG_SPEC_TYPE (#20744)

ddh0 committed 72 days ago

Verified 922b90e5

ci : add action for finding duplicate issues (#20756)

ggerganov committed 72 days ago

Verified f071ce67

Server becomes the source of truth for sampling parameter defaults (#20558)

ServeurpersoCom committed 73 days ago

Verified 4065c1a3

mtmd: add clip_graph::build_mm() (#20751)

ngxson committed 73 days ago

Verified 1e645345

Older