vllm-project/vllm

Pull Requests Commits

ywang96 committed 103 days ago

8bbfc17c

[Misc] Bump `fastsafetensors` version for latest fixes (#34273)

njhill committed 103 days ago

Verified 79504027

[torch.compile] Enable AR+rms fusion by default available for `-O2` (#34299)

ProExpertProg committed 103 days ago

Verified addac0e6

[Chore] Move `BaseRenderer` to `base.py` (#34308)

DarkLight1337 committed 103 days ago

Verified 675a22ed

[XPU][9/N] clean up existing ipex code/doc (#34111)

jikunshang committed 103 days ago

Verified cb9574eb

[model] support FunASR model (#33247)

AllenDou committed 103 days ago

Verified 21dfb842

[CPU] Enable FP16 (Half dtype) support for s390x (#34116)

R3hankhan123 committed 103 days ago

Verified d1b837f0

[Bugfix] Fix weight naming in Qwen3.5 (#34313)

ywang96 committed 103 days ago

Verified 0b20469c

[Bugfix] Fix fused MoE IMA (sans chunking) by using int64 for strides (#34279)

tlrmchlsmth committed 103 days ago

Verified d7982daf

[ModelBash][DSR1 NVFp4] Removed Bf16 Bias Cast (#34298)

robertgshaw2-redhat committed 103 days ago

Verified 9b17c574

Threshold fix wvSplitk for occasional CI fails (#34013)

amd-hhashemi committed 103 days ago

Verified 1b3540e6

[Bugfix] Fix benchmark_moe.py inplace assertion with torch >= 2.9 (#34149)

mgehre-amd committed 103 days ago

Verified 7a048ee6

[Plugin] Simplify IO Processor Plugin interface (#34236)

DarkLight1337 committed 103 days ago

Verified c9a1923b

[XPU][7/N] enable xpu fp8 moe (#34202)

zufangzhu committed 103 days ago

Verified b482f71e

[Kernel] Apply 256bit LDG/STG To Activation Kernels (#33022)

AstroVoyager7 committed 103 days ago

Verified 1485396a

[Bugfix][DeepSeek-V3.2] fix fp8 kvcache type cast (#33884)

kebe7jun committed 103 days ago

Verified 5ee5c86e

[Misc] Clean up validation logic in input processor (#34144)

DarkLight1337 committed 103 days ago

Verified b5dcb372

[WideEP] Fix nvfp4 DeepEP High Throughput All2All backend (#33738)

tlrmchlsmth committed 103 days ago

Verified 066c6da6

[torch.compile] Stop doing unnecessary FakeTensorProp in PiecewiseCompileInterpreter (#34093)

zou3519 committed 103 days ago

Verified e30cedd4

[Redo] Add `--trust-remote-code` to dataset bench args (#34251)

DarkLight1337 committed 103 days ago

Verified 3bcd494e

[Bugfix] Fix Worker.load_model context-manager composition for sleep mode (#34021)

tianshu-Michael-yu committed 103 days ago

Verified 0e725a7d

[Misc] Add run one batch script that supports profiling (#32968)

LucasWilkinson committed 103 days ago

Verified ba0511fd

[ROCm][CI] Fix test_sequence_parallel.py location in AMD CI pipeline (#34280)

micah-wil committed 103 days ago

Verified 4a1550d2

[MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344)

bnellnm committed 103 days ago

Verified d1481ba7

[CI] Add pip caching to cleanup_pr_body workflow (#32979)

sjhddh committed 103 days ago

Verified dc6de33c

[Misc] Add pre-commit hook to catch boolean ops in with-statements (#34271)

tlrmchlsmth committed 104 days ago

Verified c4b9e677

[torch.compile] Disable recursive pre_grad_passes (#34092)

zou3519 committed 104 days ago

Verified 341eed3d

[Misc][Spec Decode] support different load config for draft model (#34022)

ZhengkaiZ committed 104 days ago

Verified 6f2f59f2

[BugFix] Fix async EPLB hang with DeepEP LL all2all backend (#32860)

ilmarkov committed 104 days ago

Verified bb2fc8b5

[Perf] Move eplb rebalance algo to async thread (#30888)

ilmarkov committed 104 days ago

Verified 67132945

Older