text-generation-inference
5726a9ca - Move to moe-kernels package and switch to common MoE layer

Commit
1 year ago
Move to moe-kernels package and switch to common MoE layer This change introduces the new `moe-kernels` package: - Add `moe-kernels` as a dependency. - Introduce a `SparseMoELayer` module that can be used by MoE models. - Port over Mixtral and Deepseek.
Author
Committer
Parents
Loading