CUDA: extend MOE fusion to specdec, earlier MOE glu fusion and topk-router fusion were restricted to 1 token (#27621)
* CUDA: extend MOE fusion to specdec, earlier MOE glu fusion and topk-router fusion were resticted to 1 token
Signed-off-by: ynankani <ynankani@nvidia.com>
* Address review comments
Signed-off-by: ynankani <ynankani@nvidia.com>
* Add SWIGLU_CLAMP case to multi-token moe fusion
Signed-off-by: ynankani <ynankani@nvidia.com>
---------
Signed-off-by: ynankani <ynankani@nvidia.com>