PR #21764 ggml: add graph_reused

ggml: add graph_reused #21764

am17an merged 11 commits into ggml-org:master from am17an:ggml_graph_reuse

am17an requested a review from

ggerganov 71 days ago

am17an requested a review 71 days ago

github-actions added Nvidia GPU

github-actions added ggml

JohannesGaessler commented on 2026-04-11

gaugarg-nv commented on 2026-04-11

jeffbolznv commented on 2026-04-11

am17an force pushed from 72a96cc3 to 5dd2823e 70 days ago

JohannesGaessler commented on 2026-04-12

ggml: add graph_reused

6c80ace5

use versioning instead of reuse flag

b510b595

increment version with atomic

6d0a18b9

use top bits for split numbering

4bb088b2

add assert

fd547247

move counter to ggml.c

5d967fba

set uid in split_graph only

266c3e55

am17an force pushed from e795977d to 266c3e55 69 days ago

fix windows

ce409bc7

JohannesGaessler commented on 2026-04-13

am17an force pushed from eebe3f03 to b674f926 69 days ago

gaugarg-nv commented on 2026-04-13

am17an force pushed from b674f926 to 001e33ab 69 days ago

address further review comments

1816cc7d

am17an force pushed from 001e33ab to 1816cc7d 69 days ago

ggerganov commented on 2026-04-16

am17an force pushed from 7449178e to cf9dee0f 66 days ago

get next_uid rather than doing bit manipulation

b3a370f0

am17an force pushed from cf9dee0f to b3a370f0 66 days ago

ggerganov approved these changes on 2026-04-16

rename + add comment about uid

d6567805

JohannesGaessler approved these changes on 2026-04-16

am17an merged 3f7c29d3 into master 66 days ago

am17an deleted the ggml_graph_reuse branch 66 days ago

Reviewers

JohannesGaessler

ggerganov

gaugarg-nv

jeffbolznv

Assignees

No one assigned

Labels

Nvidia GPU ggml

Milestone

No milestone

llama.cpp ggml: add graph_reused #21764 Merged

ggml: add graph_reused #21764

llama.cpp
ggml: add graph_reused
#21764

Merged