ggerganov/llama.cpp

Pull Requests Commits

Add tensor name to JSON output

pwilkin committed 17 days ago

df6daabc

tentative Metal support

pwilkin committed 17 days ago

9ed6048d

Add missing unrolls

pwilkin committed 17 days ago

2ade1b82

Revert accidental change.

pwilkin committed 17 days ago

695dd1ea

pwilkin committed 17 days ago

f1c08eac

Fix FATTN profiling

pwilkin committed 17 days ago

49471724

Converge implementation with export-graph-ops

pwilkin committed 17 days ago

c7d42e00

Add missing op parameters to the profiler; add support for test-backend-ops to run performance tests with exactly the tensor shapes from the run

pwilkin committed 17 days ago

bfbf84a4

docs, pass copy details

pwilkin committed 17 days ago

abdf1bf2

fix mul_mat_id stats, add throughput stat, add envvar trigger, add concurrent mode fix

pwilkin committed 17 days ago

7c22aecd

fix builds, integrate vulkan profiler, fix copy events, fix export

pwilkin committed 17 days ago

2a2476e1

Fix more missing backend stuff (and Python errors)

pwilkin committed 17 days ago

609c7867

add second dimension to reported tensors, fix Mac build, add missing initializer to all backends

pwilkin committed 17 days ago

153f8d92

feat: cool profiler thingy

pwilkin committed 17 days ago

7705d453

vendor: update subprocess.h (#26061)

ngxson committed 17 days ago

Verified 0cea3622

hexagon: further improved pipeline of the core bits (L2, DMA, MM, FA) (#26049)

max-krasnyansky committed 17 days ago

Verified 0a50d990

hexagon: fix Windows crash when op_poll is enabled (#26029)

adgup committed 18 days ago

Verified c0bc8591

CUDA: fix external compilation of q1_0 MMQ (#25778)

JohannesGaessler committed 18 days ago

Verified 1425386f

args: refactor mlock/mmap/directio into load-mode (#20834)

taronaeo committed 18 days ago

Verified e6dd0e29

contrib: fix leftovers from the AI usage policy update (#26030)

ServeurpersoCom committed 18 days ago

Verified da296d6e

metal : add f16 type support to leaky relu (#25981)

iliailmer committed 18 days ago

Verified c588c4f4

conversion: fix non-MoE NomicBert GGUF conversion error (#25996)

aorko01 committed 18 days ago

Verified d941f6e1

contrib: allow all AI-generated code in general (#26012)

ngxson committed 18 days ago

Verified 4310aa4f

ui: Add a "Default" option for the reasoning selector (#25846)

ServeurpersoCom committed 18 days ago

Verified cf512566

CUDA: Improve NVFP4 W4A4 activation quantization (#25730)

ORippler committed 19 days ago

Verified 1a064ab0

hexagon: activation ops update (#25974)

tboinovski1 committed 19 days ago

Verified 0278d836

mtmd: use RAII for setting and resetting non-causal attention (#25723)

nikwen committed 19 days ago

Verified e0833bf6

feat(ui): add symbolic math support to JS sandbox via nerdamer (#25948)

rankaiyx committed 19 days ago

Verified 61328e6a

minor: fix reasoning preserve var for DS4 [no ci] (#25999)

pwilkin committed 19 days ago

Verified e8e6c7af

common: infer the speculative type from the draft repo sidecars (#25989)

ServeurpersoCom committed 19 days ago

Verified 6d5a910c

Older