vllm
[NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel
#26714
Merged
Overview
Commits
6
Changes
View On GitHub

[NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel #26714

vllm-bot merged 6 commits into vllm-project:main from jiahanc:trtllmgen-throughput
jiahanc
mgoin mgoin assigned mgoin mgoin 293 days ago
jiahanc
jiahanc jiahanc changed the title Trtllmgen throughput Update to leverage flashinfer trtllm FP4 MOE throughput kernel 293 days ago
mergify mergify added ci/build
jiahanc remove get_til_tokens_dim
dae36d6c
jiahanc fix lint
2b3f2d4a
jiahanc fix lint
a6a07805
jiahanc update flashinfer to v0.4.1
c2a2f037
jiahanc jiahanc force pushed to c2a2f037 292 days ago
jiahanc jiahanc marked this pull request as ready for review 292 days ago
jiahanc jiahanc requested a review from mgoin mgoin 292 days ago
jiahanc jiahanc requested a review from tlrmchlsmth tlrmchlsmth 292 days ago
jiahanc jiahanc requested a review from WoosukKwon WoosukKwon 292 days ago
jiahanc jiahanc requested a review from yewentao256 yewentao256 292 days ago
jiahanc jiahanc requested a review from robertgshaw2-redhat robertgshaw2-redhat 292 days ago
jiahanc jiahanc changed the title Update to leverage flashinfer trtllm FP4 MOE throughput kernel [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel 292 days ago
jiahanc jiahanc changed the title [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel 292 days ago
jiahanc
jiahanc commented on 2025-10-14
jiahanc
benchislett
jiahanc remove not need log
700c4cc0
mgoin
mgoin approved these changes on 2025-10-15
mgoin mgoin enabled auto-merge (squash) 291 days ago
github-actions github-actions added ready
mgoin Merge branch 'main' into trtllmgen-throughput
7ffd4d75
jiahanc
mgoin
vllm-bot vllm-bot merged 41d30719 into main 289 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
ready ci/build
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum