text-generation-inference
Add `DenseMoELayer` and wire it up in Mixtral/Deepseek V2
#2537
Merged

Add `DenseMoELayer` and wire it up in Mixtral/Deepseek V2 #2537

danieldk merged 1 commit into main from maintenance/dense-moe-layer
danieldk
danieldk Add `DenseMoELayer` and wire it up in Mixtral/Deepseek V2
f10144cd
danieldk danieldk force pushed from e9090abc to f10144cd 1 year ago
Narsil
Narsil approved these changes on 2024-09-24
danieldk danieldk merged 3f14cd14 into main 1 year ago
danieldk danieldk deleted the maintenance/dense-moe-layer branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone