Fix ReplicatedLinear weight loading #6793
simon-mo
merged
1 commit into
vllm-project:main
from
qingquansong:fix_mixtral_moe_linear_loading
Fix ReplicatedLinear for quantized mixtral loading
c5e8e3ad
qingquansong
changed the title 
comaniac
approved these changes
on 2024-07-25
mgoin
approved these changes
on 2024-07-25
disabled auto-merge 1 year ago
Manually disabled by user
Manually disabled by user
Login to write a write a comment.
Login via GitHub