[Misc] DeepGemmExperts : Avoid JIT generation in the hot-path #21955
vllm-bot
merged
12 commits into
vllm-project:main
from
neuralmagic:varun/deep-gemm-warmup
add deepgemm warmups
30afbc1b
fixes
cc752949
gemini-code-assist
commented
on 2025-07-30
bnellnm
commented
on 2025-07-30
fix block_m
2bfe1730
bnellnm
commented
on 2025-07-30
rename warmup_deepgemm_kernels -> warmup_deepgemm_gg_contiguous_kerenls
90ea8393
fix progress-bar comment
6559c0a2
tlrmchlsmth
commented
on 2025-07-30
distribute expert-ids evenly
a859d275
tlrmchlsmth
commented
on 2025-07-30
yewentao256
approved these changes
on 2025-07-31
fix deep-gemm cache path
3395b1d4
add VLLM_DISABLE_DEEP_GEMM_WARMUP
9ef502b9
move imports outside function
b12fd6f4
fixes
95ed8709
varun-sundar-rabindranath
commented
on 2025-08-01
varun-sundar-rabindranath
commented
on 2025-08-01
VLLM_DISABLE_DEEP_GEMM_WARMUP -> VLLM_SKIP_DEEP_GEMM_WARMUP
99eb49c3
check existence of cache path
d806725e
tlrmchlsmth
approved these changes
on 2025-08-01
Reviewers
Assignees
No one assigned
Labels
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub