vllm-project/vllm

Pull Requests Commits

potential hang fix

LucasWilkinson committed 73 days ago

db77f9b3

Eagle3 that supports the Minicpm3 model (#24243)

LDLINGLINGLING committed 73 days ago

Verified 33f6aaf9

[Misc] fix unique_filepath (#25732)

ZJY0516 committed 73 days ago

Verified 56aafa8c

[ray][metrics] Replace ':' with '_' for OpenTelemetry compatibility in Ray (#25439)

eicherseiji committed 73 days ago

Verified 8d52f2b3

[BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring `dbo_prefill_token_threshold`) (#25622)

LucasWilkinson committed 73 days ago

Verified 984d1849

[Quantization] Add field to skip unquantized modules for GPTQ config (#25455)

Isotr0py committed 73 days ago

Verified d4d98998

[CI/Build] Fix some V1 tests not being run (#25569)

DarkLight1337 committed 73 days ago

Verified db1e42f6

[CI/Build] Split up Distributed Tests (#25572)

DarkLight1337 committed 73 days ago

Verified bc9d7b55

[Bugfix] Properly abort pooling request. (#25734)

noooop committed 73 days ago

Verified fe6b19c3

[CI] Fix test_shared_storage_connector_hashes (#25748)

chaunceyjiang committed 73 days ago

Verified 2827b3f4

[Model] Mamba2 varlen refactor (#21467)

cyang49 committed 73 days ago

Verified 2b6b1d78

[Doc] Update Batch-level DP docs (#25757)

DarkLight1337 committed 73 days ago

Verified 633f943e

Support LongCat-Flash-Chat tool call (#24083)

Xu-Wenqing committed 73 days ago

Verified b03b1b97

[Bugfix] Fix Shared Expert/Zero expert code in FusedMoE.process_chunk (#25698)

SageMoore committed 73 days ago

Verified dfb9af20

[misc] refactor speculative config (#25657)

yyzxw committed 73 days ago

Verified 19f76ee6

Remove cuda hard-code in compute_causal_conv1d_metadata (#25555)

wxsIcey committed 73 days ago

Verified dd70437a

[Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride bug in causal_conv_1d. (#25743)

sighingnow committed 73 days ago

Verified 99b3a504

fix: print outputt offline_inference/base/chat.py example (#25744)

Iceber committed 73 days ago

Verified 6e30010d

[Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI300X (#25703)

xaguilar-amd committed 73 days ago

Verified 52621c8f

perf: Avoid copying inputs_embeds tensors to GPU unless prompt_embeds is enabled (#25739)

qthequartermasterman committed 73 days ago

Verified d48f4d6d

fix: revert cast to cpu in `MsgpackEncoder._encode_tensor` to avoid hidden performance regressions (#25738)

qthequartermasterman committed 73 days ago

Verified e84e0735

[CI/Build] fix doc build warning: Failed to get 'name: description' pair (#25733)

yitingdc committed 73 days ago

Verified 3edf87d2

EVS Support (Video tokens pruning) (#22980)

BloodAxe committed 73 days ago

Verified 392edee3

[Misc] Remove unnecessary memoryviews in shm_broadcast.py (#25721)

njhill committed 73 days ago

Verified 983056e4

[Core] Force PIECEWISE CUDAGraph mode for encoder-decoder (#25701)

russellb committed 73 days ago

Verified 13dd93c6

Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135)

maleksan85 committed 73 days ago

Verified 53a30845

[Misc] Don't log shm dequeue delay warning on worker side (#25720)

njhill committed 73 days ago

Verified 8b77328f

[Refactor] Remove DeepGEMM OP Register (#25710)

yewentao256 committed 73 days ago

Verified 9fe4c2bd

Fix routing_bias dtype (#25711)

wenscarl committed 73 days ago

Verified 081b5594

[Model] rename NemotronH_Nano_VL -> NemotronH_Nano_VL_V2 (#25708)

tomeras91 committed 73 days ago

Verified 57329a8c

Older