vllm-project/vllm

Pull Requests Commits

Merge branch 'main' of https://github.com/neuralmagic/vllm into sage/dbo-cudagraph-size

SageMoore committed 98 days ago

a4516dc1

[V1] address post issues related to #20059 (part 1) (#23046)

fhl2000 committed 98 days ago

Verified f075693d

[CI] Add E2E Blackwell Quantized MoE Test (#25723)

mgoin committed 98 days ago

Verified f708bd49

[Docs] Add Toronto Meetup (#25773)

mgoin committed 98 days ago

Verified 0002b7f0

[Bugfix] Improve GLM4 MoE Reasoning Parser's is_reasoning_end Condition (#25355)

frankwang28 committed 98 days ago

Verified 11aafd98

SageMoore committed 98 days ago

2f29120a

SageMoore committed 98 days ago

1fc9de4c

[Doc]: improve CPU(x86) build-wheel-from-source section (#25617)

brokedba committed 98 days ago

Verified b761df96

Eagle3 that supports the Minicpm3 model (#24243)

LDLINGLINGLING committed 98 days ago

Verified 33f6aaf9

[Misc] fix unique_filepath (#25732)

ZJY0516 committed 98 days ago

Verified 56aafa8c

[ray][metrics] Replace ':' with '_' for OpenTelemetry compatibility in Ray (#25439)

eicherseiji committed 98 days ago

Verified 8d52f2b3

[BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring `dbo_prefill_token_threshold`) (#25622)

LucasWilkinson committed 98 days ago

Verified 984d1849

[Quantization] Add field to skip unquantized modules for GPTQ config (#25455)

Isotr0py committed 98 days ago

Verified d4d98998

[CI/Build] Fix some V1 tests not being run (#25569)

DarkLight1337 committed 98 days ago

Verified db1e42f6

[CI/Build] Split up Distributed Tests (#25572)

DarkLight1337 committed 98 days ago

Verified bc9d7b55

[Bugfix] Properly abort pooling request. (#25734)

noooop committed 98 days ago

Verified fe6b19c3

[CI] Fix test_shared_storage_connector_hashes (#25748)

chaunceyjiang committed 98 days ago

Verified 2827b3f4

[Model] Mamba2 varlen refactor (#21467)

cyang49 committed 98 days ago

Verified 2b6b1d78

[Doc] Update Batch-level DP docs (#25757)

DarkLight1337 committed 99 days ago

Verified 633f943e

Support LongCat-Flash-Chat tool call (#24083)

Xu-Wenqing committed 99 days ago

Verified b03b1b97

[Bugfix] Fix Shared Expert/Zero expert code in FusedMoE.process_chunk (#25698)

SageMoore committed 99 days ago

Verified dfb9af20

[misc] refactor speculative config (#25657)

yyzxw committed 99 days ago

Verified 19f76ee6

Remove cuda hard-code in compute_causal_conv1d_metadata (#25555)

wxsIcey committed 99 days ago

Verified dd70437a

[Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride bug in causal_conv_1d. (#25743)

sighingnow committed 99 days ago

Verified 99b3a504

fix: print outputt offline_inference/base/chat.py example (#25744)

Iceber committed 99 days ago

Verified 6e30010d

[Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI300X (#25703)

xaguilar-amd committed 99 days ago

Verified 52621c8f

perf: Avoid copying inputs_embeds tensors to GPU unless prompt_embeds is enabled (#25739)

qthequartermasterman committed 99 days ago

Verified d48f4d6d

fix: revert cast to cpu in `MsgpackEncoder._encode_tensor` to avoid hidden performance regressions (#25738)

qthequartermasterman committed 99 days ago

Verified e84e0735

[CI/Build] fix doc build warning: Failed to get 'name: description' pair (#25733)

yitingdc committed 99 days ago

Verified 3edf87d2

EVS Support (Video tokens pruning) (#22980)

BloodAxe committed 99 days ago

Verified 392edee3

Older