text-generation-inference
3f14cd14 - Add `DenseMoELayer` and wire it up in Mixtral/Deepseek V2 (#2537)

Commit

1 year ago

Add `DenseMoELayer` and wire it up in Mixtral/Deepseek V2 (#2537) This replaces the custom layers in both models.

References

Author

danieldk

Parents