llama.cpp
e57dc620 - llama: Add support for Gemma2ForCausalLM (#8156)

Comment changes are shownComment changes are hidden
Commit
346 days ago
llama: Add support for Gemma2ForCausalLM (#8156) * Inference support for Gemma 2 model family * Update convert-hf-to-gguf.py, constants, and tensor mappings * cleanup * format fix * Fix special token vocab bug * Don't add space prefix * fix deleted lines * Update src/llama.cpp Co-authored-by: slaren <slarengh@gmail.com> * Add model type names * Add control vector * Fix model type identification --------- Co-authored-by: Andrei Betlen <abetlen@gmail.com> Co-authored-by: slaren <slarengh@gmail.com>
Author
Parents
  • File
    convert-hf-to-gguf.py
  • gguf-py/gguf
    • File
      constants.py
    • File
      tensor_mapping.py
  • src
    • File
      llama.cpp