llama.cpp
580111d4 - llama : add `gemma` model (#5631)

Commit
1 year ago
llama : add `gemma` model (#5631) There are couple things in this architecture: 1. Shared input and output embedding parameters. 2. Key length and value length are not derived from `n_embd`. More information about the models can be found at https://ai.google.dev/gemma. GGUFs can be downloaded from https://huggingface.co/google.
Author
Parents
Loading