Commits vllm-project/vllm

[Bugfix] Fix getting vision features in Transformer Multimodal backend (#32933)

zucchini-nlp committed 29 days ago

Verified d95d6507

[Feature]: Remove DtoH Copy for lfm2_vl On Default Stream (#32815)

tianshu-Michael-yu committed 29 days ago

Verified 13d8746c

[CPU][Feat] Update PyTorch to v2.10 for CPU Backend (#32869)

fadara01 committed 29 days ago

Verified 10e94c84

[Benchmark][Bugfix] Fix race condtion when starting server for sweep benchmark (#32927)

Isotr0py committed 29 days ago

Verified 243e78c2

[CPU Backend][BugFix] Fix failing CPU MoE test (#32876)

fadara01 committed 29 days ago

Verified aac0b817

[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest (#32905)

noooop committed 29 days ago

Verified 05f3d714

[Voxtral] Add new streaming arch (#32861)

patrickvonplaten committed 29 days ago

Verified 3f3f8952

[CI/Build][CPU] Fix failed pooling tests and macos smoke test (#32907)

bigPYJ1151 committed 29 days ago

Verified 5da4c7d7

[Misc] Add `get_name` to missing AttentionBackends (#32698)

NickLucche committed 29 days ago

Verified 160c6fa3

[CI][Models] Add VLM Support for Sequence Classification Conversion (#32885)

AndreasKaratzas committed 29 days ago

Verified a8eb1182

[Bugfix] Fix _CPU_MOE_ACT AssertionError when vLLM config not set (#32777)

karanb192 committed 29 days ago

Verified fa6e599a

[CI] Fix mypy for `vllm/v1/structured_output` (#32722)

yewentao256 committed 29 days ago

Verified 7ef58737

[torch.compile] Compile `CustomOp.forward_native` for `SiluAndMul` and `QuantFP8` to avoid raw torch ops inside opaque custom ops (#32806)

ProExpertProg committed 29 days ago

Verified 5e4e0e51

[BugFix] deepseek_v32_encoding: Replace asserts with proper exceptions (#32884)

RishabhSaini committed 29 days ago

Verified f61c9da7

[Misc] Log vLLM logo when starting server (#32796)

njhill committed 29 days ago

Verified 7fe25588

[MoE Refactor] Move `select_experts` from `FusedMoEQuantMethod` -> `FusedMoE` (#31996)

bnellnm committed 30 days ago

Verified dc917cce

[BugFix] Fix invalid flashinfer_fused_moe_blockscale_fp8 op registration (#32855)

fadara01 committed 30 days ago

Verified fc56f4a0

[Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619)

xyang16 committed 30 days ago

Verified d08b356e

[Refactor] Remove unused tpu files (#32610)

yewentao256 committed 30 days ago

Verified f7448101

Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141)

eldarkurtic committed 30 days ago

Verified 44f08af3

[Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 (#32795)

MatthewBonanni committed 30 days ago

Verified 955b43a5

[CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across NUMA domains on Arm (#32792)

fadara01 committed 30 days ago

Verified 744ef304

[CI][Attention] Add more CI dependencies for attention tests (#32487)

MatthewBonanni committed 30 days ago

Verified 300622e6

[Feature] Add --ssl-ciphers CLI argument for TLS cipher control (#30937)

ricky-chaoju committed 30 days ago

Verified 69d09fdd

Support custom URI schemes and trace handlers for profiler (#32393)

diviramon committed 30 days ago

Verified 3a63be0f

[UX] Default api_server_count to dp_size if not specified (#32525)

tlrmchlsmth committed 30 days ago

Verified 803e3f3f

[MISC] Add .cursor to .gitignore (#32868)

vadiklyutiy committed 30 days ago

Verified 70917b1c

[Hardware][AMD][CI][Bugfix] Fix regressions from deprecated env vars (#32837)

mawong-amd committed 30 days ago

Verified c517d8c9

[Bugfix] ModelScope is supported when downloading LORA models. (#32844)

AuYang261 committed 30 days ago

Verified fc37187a

Support bge-m3 sparse embeddings and colbert embeddings (#14526)

maxdebayser committed 30 days ago

Verified ff365eea