vllm
07278c37 - [Model] Support Nemotron models (Nemotron-3, Nemotron-4, Minitron) (#6611)

Commit

337 days ago

[Model] Support Nemotron models (Nemotron-3, Nemotron-4, Minitron) (#6611)

References

#6611 - [Model] Support Nemotron models (Nemotron-3, Nemotron-4, Minitron)

Author

mgoin

mgoin

Parents

Files9

.buildkite/lm-eval-harness/configs
- Minitron-4B-Base.yaml
- models-small.txt
vllm
- model_executor
  - layers
    - activation.py
    - rotary_embedding.py
  - models
    - __init__.py
    - nemotron.py
- transformers_utils
  - config.py
  - configs
    - __init__.py
    - nemotron.py