ggerganov/llama.cpp

Pull Requests Commits

model : fix Granite Hybrid type check for 7B.A1B (#20795)

victor-villar committed 15 days ago

Verified 58c81f7e

server: (doc) clarify in-scope and out-scope features (#20794)

ngxson committed 15 days ago

Verified fb78ad29

vulkan: change gated_delta_net to shard a column across a subgroup (#20662)

jeffbolznv committed 15 days ago

Verified e06c3ab2

context: zero output buffer on allocation (#20781)

retr0reg committed 15 days ago

Verified dc659243

model: assert nextn_predict_layers to prevent underflow (#20783)

retr0reg committed 15 days ago

Verified 3adbef77

server : improve mtmd ctx checkpoints (#20726)

ggerganov committed 15 days ago

Verified ab9d4c36

CANN: add BF16 support for core operators (#20152)

hipudding committed 15 days ago

Verified 1af9dab3

docs : fix Metal backend op support status in ops.md (#20779)

seyoungjeong committed 15 days ago

Verified 6d99b44c

ai : update find-related action (#20790)

ggerganov committed 15 days ago

Verified 464fd0e7

jinja : fix heap OOB read in value equality comparison (#20782)

retr0reg committed 15 days ago

Verified 21c80452

common/parser : fix out_of_range crash in throw path (#20424 regression) (#20777)

jpohhhh committed 16 days ago

Verified c46583b8

server: fix router mode deadlock on child crash and TOCTOU race in models_max (#20763)

BenRacicot committed 16 days ago

Verified c1b91165

docs: Update server README to reflect PR #20297 (#20560)

Tomeamis committed 16 days ago

Verified b739738d

ggml: guard KleidiAI DOWNLOAD_EXTRACT_TIMESTAMP for cmake < 3.24 (#20767)

sundaram123krishnan committed 16 days ago

Verified a0bbcdd9

ci : improve action for duplicate issue (#20772)

ggerganov committed 16 days ago

Verified 6c72646a

hip: Avoid compiler bug in RDNA code generation during debug builds on Windows (#20655)

Exile333 committed 16 days ago

Verified 34080727

server: Add cached_tokens info to oaicompat responses (#19361)

percontation committed 16 days ago

Verified 26c9ce12

chat : handle tool calls with no required args in TAG_WITH_TAGGED format (#20764)

jpohhhh committed 16 days ago

Verified 76f2dc70

ci : clarify gh command for viewing issues (#20766)

ggerganov committed 16 days ago

Verified 900efd53

hexagon: add Matrix Extensions (HMX) for Hexagon NPU backend (#20693)

njsyw1997 committed 16 days ago

Verified 74c42ee1

ci : add hip quality check (#20430)

IMbackK committed 16 days ago

Verified b49d8b87

common/parser: add proper reasoning tag prefill reading (#20424)

pwilkin committed 16 days ago

Verified 5e54d51b

ggml webgpu: ops support for qwen3.5 (SET, TRI_SOLVE, SSM_CONV, GATED_DELTA_NET) + GET_ROWS optimization (#20687)

reeselevine committed 16 days ago

Verified c1258830

common : add LLAMA_ARG_SPEC_TYPE (#20744)

ddh0 committed 16 days ago

Verified 922b90e5

ci : add action for finding duplicate issues (#20756)

ggerganov committed 16 days ago

Verified f071ce67

Server becomes the source of truth for sampling parameter defaults (#20558)

ServeurpersoCom committed 16 days ago

Verified 4065c1a3

mtmd: add clip_graph::build_mm() (#20751)

ngxson committed 16 days ago

Verified 1e645345

WebUI: Persist the on/off state of the MCP servers for new conversations (#20750)

ServeurpersoCom committed 16 days ago

Verified cd708db0

webui: Improve model parsing logic + add unit tests (#20749)

allozaur committed 16 days ago

Verified 512bba6e

convert : support is_causal hyperparameter (#20746)

Bing-su committed 16 days ago

Verified b486c17b

Newer Older