vllm
5eeadc26 - [Hardware][Gaudi][Feature] Enable Dynamic MoE for Mixtral (#12303)
Commit
View On GitHub
Comment changes are shownComment changes are hidden
Commit
96 days ago
[Hardware][Gaudi][Feature] Enable Dynamic MoE for Mixtral (#12303) Signed-off-by: zhenwei <zhenweiliu@habana.ai>
Author
zhenwei-intel zhenwei-intel
Parents
3aee6573
  • vllm
    • model_executor
      • layers/fused_moe
        • File
          layer.py
      • model_loader
        • File
          loader.py
    • worker
      • File
        hpu_model_runner.py
FAQ Terms Privacy Refunds Impressum