llama.cpp
108e53c2 - llama : add support for GPT2, Bloom and CodeShell tied word embeddings (#12456)

Commit
1 year ago
llama : add support for GPT2, Bloom and CodeShell tied word embeddings (#12456) * Add support for GPT2, Bloom and CodeShell tied word embeddings * Deduplicate tied word embeddings weights * Workaround for incorrect weight map It appears transformer.wte.weight is in the weight map even though the weights are not there, remove it if output weights are encountered first. * check++ * fatfingers--
Author
Parents
Loading