Add moe prefill/ decode with int2/int4/int8 sym /asym and fp8 e4m3 e5m2 (#1813)
Signed-off-by: Dong, Bo1 <bo1.dong@intel.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: a32543254 <53296245+a32543254@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: copilot <copilot@github.com>
Co-authored-by: Dong, Bo1 <bo1.dong@intel.com>
Co-authored-by: Dong, Bo <472452063@qq.com>