vllm
9352cdb5 - [Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning (#16263)

Comment changes are shownComment changes are hidden
Commit
19 days ago
[Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning (#16263) Signed-off-by: Lu Fang <lufang@fb.com> Co-authored-by: Lu Fang <lufang@fb.com>
Author
Parents
  • benchmarks/kernels
    • File
      benchmark_moe.py
  • vllm
    • model_executor/layers/fused_moe/configs
      • File
        E=128,N=1024,device_name=AMD_Instinct_MI300X.json
    • platforms
      • File
        rocm.py
Loading