ngxson/llama.cpp

Pull Requests Commits

ngxson committed 5 days ago

37f8f77a

move sleeping to state

ngxson committed 5 days ago

02c8b885

ngxson committed 5 days ago

5b6839b7

server: allow router to report child instances sleep status

ngxson committed 5 days ago

f4a09da9

docs : explicit about banning accounts that violates policy (#19593)

ngxson committed 5 days ago

Verified 568aec82

fix(rpc): prevent division by zero in deserialize_tensor (#20712)

y198nt committed 5 days ago

Verified 2bcdddd5

Convert: Make NVFP4 and MXFP4 HF conversions say NVFP4/MXFP4 instead of BF16 (#20730)

michaelw9999 committed 6 days ago

Verified eac9c6ea

ci : switch from pyright to ty (#20826)

CISC committed 6 days ago

Verified 29b28a98

Add shader count for Intel Arc Pro B60 (#20818)

TheBlueMatt committed 6 days ago

Verified cea560f4

common/parser: fix nasty bug causing subtle corruption of generation prompt (#20825)

pwilkin committed 6 days ago

Verified b1c70e2e

ggml-cpu: add always_inline to tinyBLAS_PPC accumulator saves (#20791)

shalinib-ibm committed 6 days ago

Verified e6ec21e6

ai : limit runtime of the agent (#20816)

ggerganov committed 6 days ago

Verified 4cb7e0bd

common : fix typo in debug log ('extracft' -> 'extract') (#20807)

jpohhhh committed 6 days ago

Verified 149b2493

ai : do not run bash commands in the prompt (#20810)

ggerganov committed 6 days ago

Verified b31b30f3

model : fix Granite Hybrid type check for 7B.A1B (#20795)

victor-villar committed 6 days ago

Verified 58c81f7e

server: (doc) clarify in-scope and out-scope features (#20794)

ngxson committed 6 days ago

Verified fb78ad29

vulkan: change gated_delta_net to shard a column across a subgroup (#20662)

jeffbolznv committed 7 days ago

Verified e06c3ab2

context: zero output buffer on allocation (#20781)

retr0reg committed 7 days ago

Verified dc659243

model: assert nextn_predict_layers to prevent underflow (#20783)

retr0reg committed 7 days ago

Verified 3adbef77

server : improve mtmd ctx checkpoints (#20726)

ggerganov committed 7 days ago

Verified ab9d4c36

CANN: add BF16 support for core operators (#20152)

hipudding committed 7 days ago

Verified 1af9dab3

docs : fix Metal backend op support status in ops.md (#20779)

seyoungjeong committed 7 days ago

Verified 6d99b44c

ai : update find-related action (#20790)

ggerganov committed 7 days ago

Verified 464fd0e7

jinja : fix heap OOB read in value equality comparison (#20782)

retr0reg committed 7 days ago

Verified 21c80452

common/parser : fix out_of_range crash in throw path (#20424 regression) (#20777)

jpohhhh committed 7 days ago

Verified c46583b8

server: fix router mode deadlock on child crash and TOCTOU race in models_max (#20763)

BenRacicot committed 7 days ago

Verified c1b91165

docs: Update server README to reflect PR #20297 (#20560)

Tomeamis committed 7 days ago

Verified b739738d

ggml: guard KleidiAI DOWNLOAD_EXTRACT_TIMESTAMP for cmake < 3.24 (#20767)

sundaram123krishnan committed 7 days ago

Verified a0bbcdd9

ci : improve action for duplicate issue (#20772)

ggerganov committed 7 days ago

Verified 6c72646a

hip: Avoid compiler bug in RDNA code generation during debug builds on Windows (#20655)

Exile333 committed 7 days ago

Verified 34080727

Older