llama.cpp
lora: count lora nodes in graph_max_nodes
#18469
Merged

lora: count lora nodes in graph_max_nodes #18469

ngxson merged 8 commits into master from xsn/lora_n_nodes
ngxson
ngxson lora: count lora nodes in graph_max_nodes
e5f1e38b
ngxson ngxson requested a review from CISC CISC 1 day ago
ngxson ngxson requested a review from ggerganov ggerganov 1 day ago
ngxson 3 nodes per weight
fe2f7fc7
ngxson 4 nodes
ac6392db
ngxson keep track n_lora_nodes from llama_model
d66c5cd4
ngxson fix assert
11c4867c
ngxson rm redundant header
771a4062
CISC
CISC approved these changes on 2025-12-30
ggerganov
ggerganov approved these changes on 2025-12-30
ngxson
ngxson common: load adapters before context creation
f20b386a
ngxson use 6 nodes
8f637a66
ngxson ngxson merged cd78e57c into master 19 hours ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone