llama.cpp
Make graph_max_nodes vary by ubatch size
#17794
Merged

Make graph_max_nodes vary by ubatch size #17794

pwilkin merged 3 commits into ggml-org:master from pwilkin:graph_max_nodes
pwilkin
pwilkin Make graph_max_nodes vary by ubatch size for models where chunking mi…
7187520f
pwilkin pwilkin requested a review from ggerganov ggerganov 103 days ago
ggerganov
ggerganov approved these changes on 2025-12-06
pwilkin Update src/llama-context.h
0ee8444e
pwilkin Add missing const
9aab3945
pwilkin
pwilkin pwilkin merged e4e9c432 into master 100 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone