vllm
8ac7a8ae
- Disable fusions for batch-invariant
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 days ago
Disable fusions for batch-invariant Signed-off-by: Luka Govedič <lgovedic@redhat.com>
References
#36816 - [DO NOT MERGE][vLLM IR] 2/N batch-invariant-aware dispatching and rms_norm
#36823 - [vLLM IR] 3/N fused_add_rms_norm and maybe_inplace
#38775 - [vLLM IR] 4/N Compile native implementation
Author
ProExpertProg
Parents
a4065fee
Loading