DeepSpeed
cfa99d40 - Add support for Phi-3 small to FastGen (#5614)

Comment changes are shownComment changes are hidden
Commit
229 days ago
Add support for Phi-3 small to FastGen (#5614) Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com> Co-authored-by: Logan Adams <loadams@microsoft.com>
Author
Parents
  • deepspeed/inference/v2
    • File
      engine_factory.py
    • model_implementations
      • File
        __init__.py
      • phi3small
        • File
          __init__.py
        • File
          containers.py
        • File
          model.py
        • File
          policy.py