llama.cpp
cd78e57c - lora: count lora nodes in graph_max_nodes (#18469)

Commit
1 day ago
lora: count lora nodes in graph_max_nodes (#18469) * lora: count lora nodes in graph_max_nodes * 3 nodes per weight * 4 nodes * keep track n_lora_nodes from llama_model * fix assert * rm redundant header * common: load adapters before context creation * use 6 nodes
Author
Parents
Loading