llama.cpp
0a271d82 - model-conversion : add verbose flag in run-org-model.py (#18194)

Commit
14 days ago
model-conversion : add verbose flag in run-org-model.py (#18194) This commit adds a --verbose flag to the run-org-model.py script to enable or disable detailed debug output, such as input and output tensors for each layer. Debug utilities (summarize, debug_hook, setup_rope_debug) have been moved to utils/common.py. The motivation for this is that the detailed debug output can be useful for diagnosing issues with model conversion or execution, but it can also produce a large amount of output that may not always be needed. The script will also be further cleaned/refactored in follow-up commits.
Author
Parents
Loading