vllm
[DO NOT MERGE][vLLM IR] 2/N batch-invariant-aware dispatching and rms_norm
#36816
Open
Overview
Commits
10
Changes
View On GitHub

[DO NOT MERGE][vLLM IR] 2/N batch-invariant-aware dispatching and rms_norm #36816

ProExpertProg wants to merge 10 commits into main from luka/vllm-ir/rms-norm-batch-invariant
ProExpertProg
gemini-code-assist
gemini-code-assist commented on 2026-03-11
ProExpertProg ProExpertProg added vllm-ir
ProExpertProg ProExpertProg force pushed from 80411065 to d8fe95a5 58 days ago
ProExpertProg
ProExpertProg commented on 2026-03-12
ProExpertProg ProExpertProg force pushed from d8fe95a5 to 810b9f33 58 days ago
ProExpertProg ProExpertProg force pushed from b39721ec to faa028ba 50 days ago
mergify
mergify mergify added documentation
mergify mergify added ci/build
mergify mergify added deepseek
mergify mergify added frontend
mergify mergify added llama
mergify mergify added multi-modality
mergify mergify added new-model
mergify mergify added performance
mergify mergify added qwen
mergify mergify added gpt-oss
mergify mergify added nvidia
mergify mergify added rocm
mergify mergify added cpu
mergify mergify added structured-output
mergify mergify added speculative-decoding
mergify mergify added v1
mergify mergify added tool-calling
mergify mergify assigned sangstar sangstar 50 days ago
mergify mergify added kv-connector
ProExpertProg ProExpertProg force pushed from faa028ba 50 days ago
ProExpertProg ProExpertProg marked this pull request as ready for review 50 days ago
ProExpertProg ProExpertProg requested a review from tjtanaa tjtanaa 50 days ago
ProExpertProg ProExpertProg requested a review from yewentao256 yewentao256 50 days ago
ProExpertProg ProExpertProg requested a review from zou3519 zou3519 50 days ago
ProExpertProg ProExpertProg requested a review from youkaichao youkaichao 50 days ago
ProExpertProg ProExpertProg requested a review from BoyuanFeng BoyuanFeng 50 days ago
ProExpertProg ProExpertProg changed the title [vLLM IR] 2/N batch-invariant-aware dispatching and rms_norm [DO NOT MERGE][vLLM IR] 2/N batch-invariant-aware dispatching and rms_norm 50 days ago
mergify
yewentao256
yewentao256 commented on 2026-03-20
ProExpertProg ProExpertProg force pushed to fefd5b07 50 days ago
ProExpertProg ProExpertProg requested a review from WoosukKwon WoosukKwon 50 days ago
ProExpertProg ProExpertProg requested a review from robertgshaw2-redhat robertgshaw2-redhat 50 days ago
ProExpertProg ProExpertProg requested a review from mgoin mgoin 50 days ago
ProExpertProg ProExpertProg requested a review from tlrmchlsmth tlrmchlsmth 50 days ago
ProExpertProg ProExpertProg requested a review from houseroad houseroad 50 days ago
ProExpertProg ProExpertProg requested a review from hmellor hmellor 50 days ago
ProExpertProg
mergify
yewentao256
ProExpertProg ProExpertProg force pushed from fefd5b07 to 81c6989b 39 days ago
ProExpertProg ProExpertProg requested a review from russellb russellb 39 days ago
ProExpertProg ProExpertProg requested a review from noooop noooop 39 days ago
ProExpertProg ProExpertProg requested a review from gshtras gshtras 39 days ago
ProExpertProg ProExpertProg requested a review from patrickvonplaten patrickvonplaten 39 days ago
ProExpertProg ProExpertProg requested a review from sighingnow sighingnow 39 days ago
ProExpertProg ProExpertProg requested a review from jikunshang jikunshang 39 days ago
ProExpertProg ProExpertProg requested a review from bigPYJ1151 bigPYJ1151 39 days ago
ProExpertProg ProExpertProg requested a review from ApostaC ApostaC 39 days ago
ProExpertProg ProExpertProg requested a review from orozery orozery 39 days ago
ProExpertProg ProExpertProg requested a review from tdoublep tdoublep 39 days ago
ProExpertProg ProExpertProg requested a review from pavanimajety pavanimajety 39 days ago
ProExpertProg ProExpertProg requested a review from DarkLight1337 DarkLight1337 39 days ago
ProExpertProg ProExpertProg requested a review from ywang96 ywang96 39 days ago
ProExpertProg ProExpertProg requested a review from NickLucche NickLucche 39 days ago
ProExpertProg ProExpertProg requested a review from aarnphm aarnphm 39 days ago
ProExpertProg ProExpertProg requested a review from njhill njhill 39 days ago
ProExpertProg ProExpertProg requested a review from benchislett benchislett 39 days ago
ProExpertProg ProExpertProg requested a review from luccafong luccafong 39 days ago
ProExpertProg ProExpertProg requested a review from MatthewBonanni MatthewBonanni 39 days ago
ProExpertProg ProExpertProg requested a review from zhuohan123 zhuohan123 39 days ago
ProExpertProg ProExpertProg requested a review from alexm-redhat alexm-redhat 39 days ago
ProExpertProg ProExpertProg requested a review from LucasWilkinson LucasWilkinson 39 days ago
ProExpertProg ProExpertProg requested a review from chaunceyjiang chaunceyjiang 39 days ago
ProExpertProg ProExpertProg requested a review from heheda12345 heheda12345 39 days ago
ProExpertProg ProExpertProg requested a review from 22quinn 22quinn 39 days ago
mergify
mergify mergify added intel-gpu
mergify
mergify mergify added needs-rebase
ProExpertProg ProExpertProg requested a review from vadiklyutiy vadiklyutiy 39 days ago
mergify mergify removed needs-rebase
mergify
ProExpertProg ProExpertProg force pushed from 49ddf9bf to 06de5e11 38 days ago
ProExpertProg ProExpertProg requested a review from ZJY0516 ZJY0516 38 days ago
ProExpertProg ProExpertProg requested a review from tomeras91 tomeras91 38 days ago
ProExpertProg ProExpertProg requested a review from markmc markmc 38 days ago
ProExpertProg ProExpertProg requested a review from jeejeelee jeejeelee 38 days ago
mergify
mergify
mergify mergify added needs-rebase
ProExpertProg ProExpertProg changed the base branch from luka/vllm-ir/rms-norm to main 38 days ago
mergify mergify removed needs-rebase
ProExpertProg ProExpertProg unassigned sangstar sangstar 38 days ago
ProExpertProg ProExpertProg removed documentation
ProExpertProg ProExpertProg removed performance
ProExpertProg ProExpertProg removed new-model
ProExpertProg ProExpertProg removed structured-output
ProExpertProg ProExpertProg removed frontend
ProExpertProg ProExpertProg removed intel-gpu
ProExpertProg ProExpertProg removed speculative-decoding
ProExpertProg ProExpertProg removed ci/build
ProExpertProg ProExpertProg removed v1
ProExpertProg ProExpertProg removed multi-modality
ProExpertProg ProExpertProg removed tool-calling
ProExpertProg ProExpertProg removed llama
ProExpertProg ProExpertProg removed qwen
ProExpertProg ProExpertProg removed deepseek
ProExpertProg ProExpertProg removed cpu
ProExpertProg ProExpertProg removed gpt-oss
ProExpertProg ProExpertProg removed kv-connector
ProExpertProg ProExpertProg removed nvidia
mergify mergify added nvidia
ProExpertProg batch invariant infra with tests
6a9d8bfe
ProExpertProg batch invariant triton impl for rms_norm
f882f0f7
ProExpertProg Extend comment vllm/ir/op.py
dafa54af
ProExpertProg ProExpertProg force pushed from c6f01a48 to dafa54af 30 days ago
ProExpertProg Add `enforce_eager` test cases to test_batch_invariance.py
1567abb0
ProExpertProg ProExpertProg added ready
mergify mergify added v1
ProExpertProg Fix comments
311ff1b8
mergify
mergify mergify added needs-rebase
ProExpertProg Fix CI tests
ba691125
ProExpertProg Merge branch 'main' into luka/vllm-ir/rms-norm-batch-invariant
a4065fee
mergify mergify added ci/build
mergify mergify removed needs-rebase
yewentao256
yewentao256 commented on 2026-04-16
yewentao256
ProExpertProg
ProExpertProg Disable fusions for batch-invariant
8ac7a8ae
ProExpertProg TMP: no cleanup post-lowering
57e7b371
ProExpertProg Disable Triton wrap by default, only enable in lowering pass
245aa274

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
rocm ready ci/build v1 nvidia vllm-ir
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum