vllm
[Model] Enable FP8 QKV in MoE and refine kernel tuning script
#5039
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
6
Changes
View On
GitHub
Commits
wip
comaniac
committed
2 years ago
a
comaniac
committed
2 years ago
script
comaniac
committed
2 years ago
add 8x22b tp=8
comaniac
committed
2 years ago
fix
comaniac
committed
2 years ago
finish tuning
comaniac
committed
2 years ago
Loading