vllm
9e19f833 - [Perf] add packed recurrent fast path for decode (#36596)

Commit

36 days ago

[Perf] add packed recurrent fast path for decode (#36596) Signed-off-by: hdj <1293066020@qq.com> Co-authored-by: Roger Wang <hey@rogerw.io>

References

Author

caozuoba

Parents