vllm
9352cdb5
- [Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning (#16263)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Hide Minimap (CTRL+M)
Commit
19 days ago
[Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning (#16263) Signed-off-by: Lu Fang <lufang@fb.com> Co-authored-by: Lu Fang <lufang@fb.com>
References
#16263 - [Hardware][AMD] Improve OAM device ID + llama4 Maverick MOE tuning
Author
xw285cornell
Parents
182f40ea
Files
3
benchmarks/kernels
benchmark_moe.py
vllm
model_executor/layers/fused_moe/configs
E=128,N=1024,device_name=AMD_Instinct_MI300X.json
platforms
rocm.py
Loading