auto-round
74143702 - Add moe prefill/ decode with int2/int4/int8 sym /asym and fp8 e4m3 e5m2 (#1813)

Commit
1 day ago
Add moe prefill/ decode with int2/int4/int8 sym /asym and fp8 e4m3 e5m2 (#1813) Signed-off-by: Dong, Bo1 <bo1.dong@intel.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: a32543254 <53296245+a32543254@users.noreply.github.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: copilot <copilot@github.com> Co-authored-by: Dong, Bo1 <bo1.dong@intel.com> Co-authored-by: Dong, Bo <472452063@qq.com>
Author
Parents
Loading