llama.cpp
9789e284 - debug : include LLAMA_POOLING_TYPE_UNSPECIFIED in pooling check (#18692)

Commit
1 day ago
debug : include LLAMA_POOLING_TYPE_UNSPECIFIED in pooling check (#18692) * debug : include LLAMA_POOLING_TYPE_UNSPECIFIED in pooling check This commit updates the pooling check in the debug example to also include LLAMA_POOLING_TYPE_UNSPECIFIED and not just LLAMA_POOLING_TYPE_NONE. * debug : normalize both pooled and token embeddings This commit updates debug.cpp to normalize embeddings for both pooled and non-pooled outputs. For pooled embeddings, normalization is applied to the single vector, and for non-pooled embeddings, normalization is applied to each token embedding vector individually. The motivation for this is to enable non-pooled embeddings to be normalized which was not possible previously.
Author
Parents
Loading