llama.cpp
7cbec34a - model-conversion : add device option to embd run orig model (#18386)

Commit
11 days ago
model-conversion : add device option to embd run orig model (#18386) This commit refactors the original model embedding script to include a device selection option. Users can now specify the device (cpu, cuda, mps, auto) via command-line arguments. It also refactors the code to be more structured.
Author
Parents
Loading