vllm
452e8fd9 - [MODEL] Add support for Zamba2 models (#13185)

Commit

117 days ago

[MODEL] Add support for Zamba2 models (#13185) Signed-off-by: Yury Tokpanov <yury@zyphra.com> Signed-off-by: Quentin Anthony <qganthony@yahoo.com> Co-authored-by: Quentin Anthony <qganthony@yahoo.com> Co-authored-by: Tyler Michael Smith <tysmith@redhat.com> Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

References

#13185 - [MODEL] Add support for Zamba2 models

Author

yury-tokpanov

Parents

8b793f7e

Files9

docs/source/models
- supported_models.md
tests/models
- decoder_only/language
  - test_hybrid.py
- registry.py
vllm
- config.py
- model_executor
  - layers/mamba
    - mamba_mixer2.py
  - models
    - bamba.py
    - jamba.py
    - registry.py
    - zamba2.py

vllm 452e8fd9 - [MODEL] Add support for Zamba2 models (#13185)

vllm
452e8fd9 - [MODEL] Add support for Zamba2 models (#13185)