vllm
[Perf] add packed recurrent fast path for decode
#36596

Merged

Commits

fla: add packed recurrent decode fast path

caozuoba committed 145 days ago
tests: fix packed recurrent decode reference call

caozuoba committed 145 days ago
style: ruff format

caozuoba committed 145 days ago
Merge branch 'main' into perf/gdn-packed

caozuoba committed 145 days ago
gdn: address review feedback

caozuoba committed 144 days ago
gdn: move decode path routing into forward core

caozuoba committed 144 days ago
refactor: inline baseline logic in forward core

caozuoba committed 143 days ago
Merge branch 'main' into perf/gdn-packed

ywang96 committed 143 days ago
Merge branch 'main' into perf/gdn-packed

caozuoba committed 143 days ago