vllm-project/vllm

Pull Requests Commits

enable flashinfer moe fp4 by default

yewentao256 committed 89 days ago

16ac78b4

[BUGFIX] Fix `test_mla_backends.py`. Scale MLA projection weights to prevent numerical instability (#32529)

vadiklyutiy committed 89 days ago

Verified 0727cc9e

[CI][amd] Revert NIXL connector change to avoid crash (#32570)

qli88 committed 89 days ago

Verified a0490be8

support dynamic resolution image encoding for Nemotron Nano VL (#32121)

netanel-haber committed 89 days ago

Verified cd3ac5b7

[Misc] Remove unused ModelKeys (#32608)

jeejeelee committed 89 days ago

Verified 2636d762

Add support for LoRA adapters in Nemotron-H models (#30802)

danisereb committed 90 days ago

Verified aa7f37cc

[Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577)

noooop committed 90 days ago

Verified c88860d7

[NIXL][Metrics] Track `nixl_num_kv_expired_reqs` metric in Prometheus (#32340)

NickLucche committed 90 days ago

Verified 758df5af

[CI/Build] Fix dependency conflict between model-hosting-container-standards and starlette (#32560)

DanielMe committed 90 days ago

Verified cdd03d25

[Core] Whisper support `torch.compile` (#30385)

NickLucche committed 90 days ago

Verified 74c583bc

[ROCm][CI] Add ROCm attention backend support for EAGLE DP tests (#32363)

AndreasKaratzas committed 90 days ago

Verified c0a350ca

[GLM-4.7] GLM Model support for GLM-Lite (#31386)

zRzRzRzRzRzRzR committed 90 days ago

Verified 71832ba7

[CI][Hardware][AMD] Fix test_rotary_embedding_mla_cache_fused (#32408)

mawong-amd committed 90 days ago

Verified 11bbf86f

[Frontend] Add render endpoints for prompt preprocessing (#32473)

hyeongyun0916 committed 90 days ago

Verified 3c8740aa

[CI/Build] Use Common Event Map Fixture in Harmony / MCP Server Tests (#32531)

alex-jw-brooks committed 90 days ago

Verified 7518a3dc

[BugFix] Fix embed_input_ids argument error of QwenVLForConditionalGeneration (#32462)

honglyua-il committed 90 days ago

Verified 976af2f3

[Model Runner V2] Refactor `update_states` (#32562)

WoosukKwon committed 90 days ago

Verified 9a1f16da

[Model Runner V2] Support VLM (#32546)

WoosukKwon committed 90 days ago

Verified bb1848cd

[BUGFIX] Fix degenerate strides in TRTLLM query tensors for FlashInfer backend. Fixes issue #32353 (#32417)

vadiklyutiy committed 90 days ago

Verified 6101a26d

[Bugfix] Add OOT backend option (#32471)

iboiko-habana committed 90 days ago

Verified f5d17400

[Refactor] Remove unused cutlass moe problem size function (#32047)

yewentao256 committed 90 days ago

Verified eebc58df

[Refactor] Remove unused file `pallas_kv_cache_update.py` (#32433)

yewentao256 committed 90 days ago

Verified 16de822c

[Doc] Correct comment for _jobs dict in OffloadingConnectorWorker (#32556)

DemingCheng committed 90 days ago

Verified 5480c6b1

Use the same memory for workspace13 and fused_output. (#31531)

halyavin committed 90 days ago

Verified ba29ab44

[CI] Move Distributed Tests from H200 -> H100 (#32555)

robertgshaw2-redhat committed 90 days ago

Verified afc36226

[MoE Refactor] Separate Router into OO Classes (#30623)

bnellnm committed 90 days ago

Verified 327a02d8

"refactor: refactor_repeated_interfaces" (#32486)

tom-zju committed 91 days ago

Verified 2f03035a

[Bugfix] Fix GLM-ASR audio encoder RoPE dim (#32540)

Isotr0py committed 91 days ago

Verified 38bf2ffb

[Model] Support Step1 Model (#32511)

randzero committed 91 days ago

Verified c826c72a

[Model] Remove the unnecessary dtype conversion in MiniCPM (#32523)

gcanlin committed 91 days ago

Verified fe36bf5e

Older