auto-round
fb2fca6a - perf: cut W4A8 prefill traffic with int8-in and fused top-k reduce

Commit

4 days ago

perf: cut W4A8 prefill traffic with int8-in and fused top-k reduce Co-authored-by: a32543254 <53296245+a32543254@users.noreply.github.com>

References

Author

Copilot

Parents