vllm-project/vllm

Pull Requests Commits

Fixed ppc build when it runs on non-RHEL based linux distros (#18422)

npanpaliya committed 185 days ago

Verified 94ecee62

improve logits bias (#19041)

yuguo68 committed 185 days ago

Verified 8267f991

[Core] Raise when non-multi-instance DP clients target a DP rank (#19227)

jmswen committed 185 days ago

Verified 7353492a

[Model] Optimize nemotron_h implementation (#19249)

jeejeelee committed 185 days ago

Verified 7661e92e

Unit Test for run_dp_sharded_vision_model (#19103)

cryptopic committed 185 days ago

Verified f168b857

Fix CompilationConfig repr (#19091)

zou3519 committed 185 days ago

Verified da511d54

[Docs] Improve V1 KVConnector interface documentation (#19172)

njhill committed 185 days ago

Verified 65c69444

[Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224)

dsikka committed 185 days ago

Verified 94870359

[TPU] fix kv cache dtype in model runner (#19244)

yaochengji committed 185 days ago

Verified 0d49483e

[v1][P/D] Fix a edge case in kv cache schedule (#19182)

KingsleyZhang123 committed 185 days ago

Verified 90b78ec5

[Chore] update CODEOWNERS (#19247)

aarnphm committed 185 days ago

Verified 91a2ef98

Support allowed_token_ids in ChatCompletionRequest (#19143)

xu-song committed 185 days ago

Verified 3da2313d

[TPU] update torch_xla pin (#19231)

yaochengji committed 185 days ago

Verified b61dc5f9

[v1] Hybrid Memory Allocator (#17996)

heheda12345 committed 185 days ago

Verified f8a1a2d1

[Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033)

benchislett committed 185 days ago

Verified 3465b87e

Fix AOPerModuleConfig name changes (#18869)

jerryzh168 committed 185 days ago

Verified c8134bea

[Model] NemotronH support (#18863)

vegaluisjose committed 186 days ago

Verified cb6d572e

[V1] Use FlashInfer by default on Blackwell GPUs (#19118)

mgoin committed 186 days ago

Verified 87360308

[Quantization] Skip Fp4 Test for `compressed-tensors` (#19217)

dsikka committed 186 days ago

Verified aa49f148

[P/D][NixlConnector] Enable FlashInfer backend (#19090)

NickLucche committed 186 days ago

Verified 9ef9173c

[MISC][Bugfix] Use less CPU when message queue has been empty for some time (#16226)

p12tic committed 186 days ago

Verified 85e2b7bb

[Hardware][NVIDIA] FP4 MoE kernel optimization (#19110)

dubcyfor3 committed 186 days ago

Verified 61059bee

Add H20-3e fused MoE kernel tuning configs for DeepSeek-R1/V3 (#19205)

Xu-Wenqing committed 186 days ago

Verified ec89524f

[mistral_common] Add v11 tokenizer (#19193)

patrickvonplaten committed 186 days ago

Verified f20f9f06

[Bugfix] properly catch PIL-related errors for vision models when incorrect data urls are provided (#19202)

gcalmettes committed 186 days ago

Verified 9bc8bb07

[Frontend] improve vllm run-batch --help display (#19187)

reidliu41 committed 186 days ago

Verified 1aeb925f

[Misc] Do not override NCCL_CUMEM_ENABLE if set explicitly (#19105)

22quinn committed 186 days ago

Verified 188a4590

[Misc] Remove unnecessary fallback to prefill-decode attention (#19138)

vllmellm committed 186 days ago

Verified 18093084

[Build] Annotate wheel and container path for release workflow (#19162)

simon-mo committed 186 days ago

Verified da403802

[Bugfix]: Fix the incompatibility issue with stream when Thinking is disabled (#19135)

chaunceyjiang committed 186 days ago

Verified 8fc57501

Newer Older