Commits vllm-project/vllm

[ROCm][Tests] Solidify entrypoint LLM lifecycle

AndreasKaratzas committed 3 days ago

4f157abd

Merge branch 'main' into akaratza_resolve_sdp_issue

AndreasKaratzas committed 4 days ago

Verified e7b21496

[Bugfix][Spec Decode] Auto-enable async scheduling for draft models (#48341)

BWAAEEEK committed 4 days ago

Verified c0202c56

[XPU] Route AWQ linear through choose_mp_linear_kernel (#50840)

zufangzhu committed 4 days ago

Verified b976e980

[XPU][Test] Support MultiConnector accuracy testing on XPU (#51160)

zhenwei-intel committed 4 days ago

Verified 2a0323b4

[XPU] Support MXFP8 linear weights for INC DeepSeek V4 model (#48476)

xwu-intel committed 4 days ago

Verified d779835a

[MM][CG] Support ViT full CUDA graph for Ernie-4.5-VL image inference (#45254)

qyYue1389 committed 4 days ago

Verified 777b01d1

[BugFix][Pooling] Skip weight-prefix probe when model has WeightsMapper (#50890)

vhagor committed 4 days ago

Verified 82171711

[Bugfix][MM] Fix MiniCPM-V placeholder replacement and image processor loading on Transformers v5 (#48413)

YunzhuLu committed 4 days ago

Verified f84df12c

[Feature] Parse request priority from HTTP header (#51089)

chaunceyjiang committed 4 days ago

Verified 22170354

[Docs] List Intel XPU attention backends (#51215)

baodii committed 4 days ago

Verified 2e09247c

[Hardware] Use torch.accelerator.empty_host_cache() for host cache cl… (#51107)

zhenwei-intel committed 4 days ago

Verified d54b58cc

[Model Runner V2] Cache draft logits in model's LM head dtype (#50910)

TheEpicDolphin committed 4 days ago

Verified 81bc1969

K3: remove the add operation for megamoe path (#51146)

jeejeelee committed 4 days ago

Verified f85c1d2f

[ROCm][CI] Add MLA decode accuracy and determinism tests (#50480)

aarushjain29 committed 4 days ago

Verified 71f975af

[MoE] Align TRTLLM MXFP4 autotune buckets (#50942)

gau-nernst committed 4 days ago

Verified 9f316996

[Bugfix] Fix level-2 sleep/wake/reload with enable_lora=True (#39935)

SilenNaihin committed 4 days ago

Verified b50fdebc

[BugFix] Dense multinode DP rescope with regression test (#49212)

aoshen02 committed 4 days ago

Verified 8cfa01cd

[Bugfix][Spec Decode] Fix NaN handling in rejection sampler tl.argmax (#50183)

gabriel-peracio committed 4 days ago

Verified 47a4e410

[KV Connector][Mooncake] Add tenant ID support to MooncakeStoreConnector (#48069)

Lin-z-w committed 4 days ago

Verified d36f24b6

[Bugfix] Size and iterate w13 by shard count for non-gated MoE (#51125)

aoshen02 committed 4 days ago

Verified 7c77868c

[Refactor][PCP] Make PCPManager construction extensible (#50066)

pisceskkk committed 4 days ago

Verified 811622c4

[EPD] Remove duplicate image preprocessing in EPD and enable preprocess on GPU (#50390)

gty111 committed 4 days ago

Verified b30291cf

[ROCm] Relax MLA rope+cache test tolerances for bf16 (#51083)

Rohan138 committed 4 days ago

Verified 38ebd97b

[K3 Perf] Combine multiple all gather together for SP, 1.5~3x kernel level performance improvement (#51070)

yewentao256 committed 4 days ago

Verified 87797589

[MoE Refactor] Remove MoE legacy code (#51078)

bnellnm committed 4 days ago

Verified 373fe8b8

[ROCm][CI] Add More AITER quantization/MoE kernel tests (#49375)

micah-wil committed 4 days ago

Verified 4282fe52

[Bugfix][Humming] Preserve ModelOpt FP8 weight dimensions (#51093)

netanel-haber committed 4 days ago

Verified 482c6134

[CI Bug] Fix `pydantic_core._pydantic_core.ValidationError: Input should be a valid integer` (#51179)

yewentao256 committed 4 days ago

Verified e76b71f6

[ROCm][CI] Keep rocprofiler-sdk out of DeepEP HT MoE test workers (#51173)

stefankoncarevic committed 4 days ago

Verified 65addac7