vllm
[Misc] DeepGemmExperts : Avoid JIT generation in the hot-path
#21955

Merged

Commits

add deepgemm warmups

varun-sundar-rabindranath committed 1 year ago
fixes

varun-sundar-rabindranath committed 1 year ago
fix block_m

varun-sundar-rabindranath committed 1 year ago
rename warmup_deepgemm_kernels -> warmup_deepgemm_gg_contiguous_kerenls

varun-sundar-rabindranath committed 1 year ago
fix progress-bar comment

varun-sundar-rabindranath committed 1 year ago
distribute expert-ids evenly

varun-sundar-rabindranath committed 1 year ago
fix deep-gemm cache path

varun-sundar-rabindranath committed 1 year ago
add VLLM_DISABLE_DEEP_GEMM_WARMUP

varun-sundar-rabindranath committed 1 year ago
move imports outside function

varun-sundar-rabindranath committed 1 year ago
fixes

varun-sundar-rabindranath committed 1 year ago
VLLM_DISABLE_DEEP_GEMM_WARMUP -> VLLM_SKIP_DEEP_GEMM_WARMUP

varun-sundar-rabindranath committed 1 year ago
check existence of cache path

varun-sundar-rabindranath committed 1 year ago