vllm-project/vllm

Pull Requests Commits

full cg support

LucasWilkinson committed 148 days ago

ebfce922

[Doc]: improve CPU(x86) build-wheel-from-source section (#25617)

brokedba committed 148 days ago

Verified b761df96

Eagle3 that supports the Minicpm3 model (#24243)

LDLINGLINGLING committed 148 days ago

Verified 33f6aaf9

[Misc] fix unique_filepath (#25732)

ZJY0516 committed 148 days ago

Verified 56aafa8c

[ray][metrics] Replace ':' with '_' for OpenTelemetry compatibility in Ray (#25439)

eicherseiji committed 148 days ago

Verified 8d52f2b3

[BugFix] Fix using `dbo_decode_token_threshold` always (and ignoring `dbo_prefill_token_threshold`) (#25622)

LucasWilkinson committed 148 days ago

Verified 984d1849

[Quantization] Add field to skip unquantized modules for GPTQ config (#25455)

Isotr0py committed 148 days ago

Verified d4d98998

[CI/Build] Fix some V1 tests not being run (#25569)

DarkLight1337 committed 149 days ago

Verified db1e42f6

[CI/Build] Split up Distributed Tests (#25572)

DarkLight1337 committed 149 days ago

Verified bc9d7b55

[Bugfix] Properly abort pooling request. (#25734)

noooop committed 149 days ago

Verified fe6b19c3

[CI] Fix test_shared_storage_connector_hashes (#25748)

chaunceyjiang committed 149 days ago

Verified 2827b3f4

[Model] Mamba2 varlen refactor (#21467)

cyang49 committed 149 days ago

Verified 2b6b1d78

[Doc] Update Batch-level DP docs (#25757)

DarkLight1337 committed 149 days ago

Verified 633f943e

Support LongCat-Flash-Chat tool call (#24083)

Xu-Wenqing committed 149 days ago

Verified b03b1b97

[Bugfix] Fix Shared Expert/Zero expert code in FusedMoE.process_chunk (#25698)

SageMoore committed 149 days ago

Verified dfb9af20

[misc] refactor speculative config (#25657)

yyzxw committed 149 days ago

Verified 19f76ee6

Remove cuda hard-code in compute_causal_conv1d_metadata (#25555)

wxsIcey committed 149 days ago

Verified dd70437a

[Qwen3-Next][GDN] fixes cuda graph capturing bug in GDN metadata and a stride bug in causal_conv_1d. (#25743)

sighingnow committed 149 days ago

Verified 99b3a504

fix: print outputt offline_inference/base/chat.py example (#25744)

Iceber committed 149 days ago

Verified 6e30010d

[Harware][AMD][Model] Triton MoE tuning configs for GLM-4.5 for MI300X (#25703)

xaguilar-amd committed 149 days ago

Verified 52621c8f

perf: Avoid copying inputs_embeds tensors to GPU unless prompt_embeds is enabled (#25739)

qthequartermasterman committed 149 days ago

Verified d48f4d6d

fix: revert cast to cpu in `MsgpackEncoder._encode_tensor` to avoid hidden performance regressions (#25738)

qthequartermasterman committed 149 days ago

Verified e84e0735

[CI/Build] fix doc build warning: Failed to get 'name: description' pair (#25733)

yitingdc committed 149 days ago

Verified 3edf87d2

EVS Support (Video tokens pruning) (#22980)

BloodAxe committed 149 days ago

Verified 392edee3

[Misc] Remove unnecessary memoryviews in shm_broadcast.py (#25721)

njhill committed 149 days ago

Verified 983056e4

[Core] Force PIECEWISE CUDAGraph mode for encoder-decoder (#25701)

russellb committed 149 days ago

Verified 13dd93c6

Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135)

maleksan85 committed 149 days ago

Verified 53a30845

[Misc] Don't log shm dequeue delay warning on worker side (#25720)

njhill committed 149 days ago

Verified 8b77328f

[Refactor] Remove DeepGEMM OP Register (#25710)

yewentao256 committed 149 days ago

Verified 9fe4c2bd

Fix routing_bias dtype (#25711)

wenscarl committed 149 days ago

Verified 081b5594

Older