vllm
Fix ReplicatedLinear weight loading
#6793
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
1
Changes
View On
GitHub
Fix ReplicatedLinear weight loading
#6793
simon-mo
merged 1 commit into
vllm-project:main
from
qingquansong:fix_mixtral_moe_linear_loading
Fix ReplicatedLinear for quantized mixtral loading
c5e8e3ad
qingquansong
changed the title
Fix ReplicatedLinear for quantized mixtral loading
Fix ReplicatedLinear weight loading
1 year ago
comaniac
approved these changes on 2024-07-25
mgoin
approved these changes on 2024-07-25
mgoin
added
ready
comaniac
enabled auto-merge (squash)
1 year ago
disabled auto-merge
1 year ago
Manually disabled by user
simon-mo
merged
062a1d0f
into main
1 year ago
Login to write a write a comment.
Login via GitHub
Reviewers
mgoin
comaniac
Assignees
No one assigned
Labels
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub