vllm-project/vllm

Pull Requests Commits

[Frontend] Improve error message in tool_choice validation (#19239)

22quinn committed 204 days ago

Verified 7e3e74c9

Add Triton Fused MoE kernel config for E=16 on B200 (#19518)

b8zhong committed 204 days ago

Verified 3f6341bf

[BugFix] Force registration of w8a8_block_fp8_matmul_deepgemm via lazy import (#19514)

varun-sundar-rabindranath committed 204 days ago

Verified e5d35d62

[CI] change spell checker from codespell to typos (#18711)

andyxning committed 205 days ago

Verified 2f1c19b2

[CI/Build] Fix torch nightly CI dependencies (#19505)

zou3519 committed 205 days ago

Verified 42f52cc9

[UX] Add Feedback During CUDAGraph Capture (#19501)

robertgshaw2-redhat committed 205 days ago

Verified 97a9465b

[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger (#17331)

rasmith committed 205 days ago

Verified c7ea0b56

[Kernels] Add activation chunking logic to FusedMoEModularKernel (#19168)

bnellnm committed 205 days ago

Verified 29fa5cac

[Docs] Remove WIP features in V1 guide (#19498)

WoosukKwon committed 205 days ago

Verified b2d9be6f

[Misc] Fix misleading ROCm warning (#19486)

jeejeelee committed 205 days ago

Verified 04a55612

[doc] fix "Other AI accelerators" getting started page (#19457)

davidxia committed 205 days ago

Verified 89b0f84e

[CI] Update FlashInfer to 0.2.6.post1 (#19297)

mgoin committed 205 days ago

Verified 497a91e9

[Bugfix] Update the example code, make it work with the latest lmcache (#19453)

runzhen committed 205 days ago

Verified 943ffa57

Support no privileged mode on CPU for docker and kubernetes deployments (#19241)

louie-tsai committed 205 days ago

Verified 5c8d34a4

Fix some typo (#19475)

Ximingwang-09 committed 205 days ago

Verified 3c8694ea

Add cache to cuda get_device_capability (#19436)

mgoin committed 205 days ago

Verified 7484e1fc

Support non-string values in JSON keys from CLI (#19471)

DarkLight1337 committed 205 days ago

Verified a2142f01

[Misc] Reduce warning message introduced in env_override (#19476)

houseroad committed 205 days ago

Verified 871d6b7c

[Doc] Support "important" and "announcement" admonitions (#19479)

DarkLight1337 committed 205 days ago

Verified 29a38f03

[Doc] Fix quantization link titles (#19478)

DarkLight1337 committed 205 days ago

Verified a5115f4f

[Doc] Update V1 User Guide for Hardware and Models (#19474)

DarkLight1337 committed 205 days ago

Verified 68b4a261

[Kernel] Support deep_gemm for linear methods (#19085)

artetaout committed 205 days ago

Verified b8e809a0

[ROCm] Add rules to automatically label ROCm related PRs (#19405)

houseroad committed 205 days ago

Verified 5039ec23

Fix Typo in Documentation and Function Name (#19442)

leopardracer committed 205 days ago

Verified 7c644ab6

Add fused MOE config for Qwen3 30B A3B on B200 (#19455)

0xjunhao committed 205 days ago

Verified 2d40665f

[Misc] Remove unused `MultiModalHasher.hash_prompt_mm_data` (#19422)

lgeiger committed 205 days ago

Verified 96ada386

[CI] Disable failing GGUF model test (#19454)

mgoin committed 205 days ago

Verified 1e473b30

Fix test_max_model_len in tests/entrypoints/llm/test_generate.py (#19451)

houseroad committed 205 days ago

Verified 2b1e2111

[BugFix] Fix docker build cpu-dev image error (#19394)

2niuhe committed 206 days ago

Verified a45b979d

[New Model]: Support Qwen3 Embedding & Reranker (#19260)

noooop committed 206 days ago

Verified 3952731e

Newer Older