Make graph_max_nodes vary by ubatch size #17794
Make graph_max_nodes vary by ubatch size for models where chunking mi…
7187520f
ggerganov
approved these changes
on 2025-12-06
Update src/llama-context.h
0ee8444e
Add missing const
9aab3945
pwilkin
merged
e4e9c432
into master 100 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub