vllm-project/vllm

Pull Requests Commits

Simplify max model length auto selection

mgoin committed 121 days ago

9874169d

[V0 Deprecation] Remove pooling model support in V0 (#23434)

maxdebayser committed 121 days ago

Verified 2554b27b

Better errors for Transformers backend missing features (#23759)

hmellor committed 121 days ago

Verified 934bebf1

[Misc] Fix warnings for mistral model (#23552)

ZJY0516 committed 121 days ago

Verified 885ca6d3

[mrope][Qwen2-VL] Fix edge case where getting index of image/video token can potentially throw in default vl mrope implementation. (#23895)

huachenheli committed 121 days ago

Verified 2d0afcc9

[CI/Build] Clean up LoRA test (#23890)

jeejeelee committed 121 days ago

Verified b4f9e963

Fix(async): Add support for truncate_prompt_tokens in AsyncLLM (#23800)

oneraghavan committed 121 days ago

Verified 05d839c1

[Platform] import activation_quant_fusion for CUDA only (#23882)

wangxiyuan committed 121 days ago

Verified 6597d7a4

[BugFix][AMD][Deepseek] fix a dtype mismatch error for deepseek running on AMD (#23864)

KingsleyZhang123 committed 121 days ago

Verified 5264015d

[Bugfix] Use `ReplicatedLinear` for SequenceClassification head (#23836)

Isotr0py committed 121 days ago

Verified 98ac0cb3

[tests] Improve speed and reliability of test_transcription_api_correctness (#23854)

russellb committed 121 days ago

Verified c8b3b299

[ROCm][Fix] Fix rocm build caused by #23791 (#23847)

charlifu committed 121 days ago

Verified 006477e6

[Models] Improve iteration over layers (#19497)

lgeiger committed 121 days ago

Verified de533ab2

[XPU] support data parallel for MoE models on XPU (#22887)

chaojun-zhang committed 121 days ago

Verified 235c9db8

[V0 Deprecation] Remove V0 Samplers test (#23862)

WoosukKwon committed 122 days ago

Verified b668055a

[Log] Use Debug Once for DeepGEMM E8M0 When not Enabled (#23858)

yewentao256 committed 122 days ago

Verified d3d2aad5

[V1] Enable prefill optimization for Gemma3n (#22628)

sarckk committed 122 days ago

Verified cb293f6a

[BugFix][FlashInfer] Fix potential race condition for paged_kv_indptr_cpu (#23737)

WoosukKwon committed 122 days ago

Verified 7ffbf272

chore: build release image by default (#23852)

simon-mo committed 122 days ago

Verified 27e88cee

[NVIDIA] Support SiluMul + NVFP4 quant fusion (#23671)

elvischenv committed 122 days ago

Verified 16a45b3a

[bugfix] [spec-decoding] fix data race in sample_recovered_tokens_kernel (vLLM v1) (#23829)

He-Jingkai committed 122 days ago

Verified 57d4ede5

[ROCm][Aiter] Add triton fp8 bmm kernel for mla (#23264)

divakar-amd committed 122 days ago

Verified 04d1dd7f

Migrate Llama4ImagePatchInputs to TensorSchema (#22021)

bbeckca committed 122 days ago

Verified f32a5bc5

Add scale_config.yml file for Meta autoscalers for GH Actions (#23840)

jeanschmidt committed 122 days ago

Verified 8805ad9f

[ci] breaks down V1 Test into 3 groups of approx 30 minutes runtime (#23757)

jeanschmidt committed 122 days ago

Verified 0583578f

[Bugfix] Add fake mode around passes (#23349)

angelayi committed 122 days ago

Verified db74d604

[Model][gpt-oss] Support DP+EP for GPT-OSS with FlashInfer trtllm-gen MoE (#23819)

nvpohanh committed 122 days ago

Verified 95089607

[CI] Fix linting error on main (#23835)

tdoublep committed 122 days ago

Verified 1f096f9b

[Bugfix] Fix benchmark_moe.py for blockwise fp8. (#23823)

crischeng committed 122 days ago

Verified 66548f66

[Doc]: fix typos in Python scripts (#23828)

didier-durand committed 122 days ago

Verified d3da2eea

Older