llama.cpp
1138b851 - model-conversion : use save_output_data for causual embeddings [no ci] (#26890)

Commit
7 days ago
model-conversion : use save_output_data for causual embeddings [no ci] (#26890) This commit updates the python script that runs the original model to generate embeddings for the causal model, to use save_output_data which stores the token ids and the prompt in addition to logits. The motivation for this is that the embedding logits verification will fail as it expects these files (-prompt.txt and -tokens.bin) to exist. With the changes in this commit the causal-verify-embeddings target works again.
Author
Parents
Loading