vllm
8ac7a8ae - Disable fusions for batch-invariant

Commit

3 days ago

Disable fusions for batch-invariant Signed-off-by: Luka Govedič <lgovedic@redhat.com>

References

#36816 - [DO NOT MERGE][vLLM IR] 2/N batch-invariant-aware dispatching and rms_norm

#36823 - [vLLM IR] 3/N fused_add_rms_norm and maybe_inplace

#38775 - [vLLM IR] 4/N Compile native implementation

Author

ProExpertProg

ProExpertProg

Parents

Loading