vllm-project/vllm

Pull Requests Commits

update torch to 2.9.1

yewentao256 committed 1 day ago

5a34ddc7

Update where `bytes_to_unicode` is imported from (#30771)

hmellor committed 1 day ago

Verified e1625498

Remove `head_mask` from Ultravox and Swin (#30764)

hmellor committed 1 day ago

Verified 0b0acc75

Fix instantiation of `HfHubHTTPError` in LoRA test (#30768)

hmellor committed 1 day ago

Verified af506fd7

[TRTLLM] Remove the MoE GEMM weight name change (#30713)

minosfuture committed 1 day ago

Verified ce12b407

[Feat] Enable eplb with default all2all backend (#30559)

yewentao256 committed 1 day ago

Verified 59bd5f6a

[BugFix] Fix memory spike in workspace allocation (#30744)

LucasWilkinson committed 1 day ago

Verified 00a8d762

[CI/Build] Skip broken ViT backend functionality test tempoarily (#30782)

Isotr0py committed 1 day ago

Verified 4de08ad6

[Bugfix] Whisper fix number of allocated CrossAttn blocks per-request (#30772)

NickLucche committed 1 day ago

Verified 75eb302a

[ROCm][MTP] Support MTP for AITER MLA backend (#28624)

ganyi1996ppo committed 1 day ago

Verified 9dbbc59b

update piecewise cudagraph warning when splitting_ops=[] (#30728)

BoyuanFeng committed 1 day ago

Verified 104003dc

[ROCm] [AITER] [DOC] Add usage description about check functions in `_aiter_ops` (#30586)

tjtanaa committed 1 day ago

Verified d0fb5729

Don'e assume `position_embedding_type` will be present for BERT and RoBERTa models (#30770)

hmellor committed 1 day ago

Verified 6f15ac5d

[Bugfix] Fix prefix_repetition routing in bench throughput (#29663)

jr-shen committed 1 day ago

Verified 676db55e

[Bugfix] Fix RequestOutput miss lora_request (#30636)

jeejeelee committed 1 day ago

Verified 0e391e75

[responsesAPI][8] input/output messages for ResponsesParser (#30158)

qandrew committed 1 day ago

Verified 0d0c929f

[Bugfix] Fix broken ViT attention selection for Blackwell device (#30731)

Isotr0py committed 1 day ago

Verified e94384bb

[feature] extend DBO to XBO (#30120)

jiangkuaixue123 committed 1 day ago

Verified b9ff4f2a

improve lazy import test (#30733)

BoyuanFeng committed 2 days ago

Verified c881db36

[CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873)

shen-shanshan committed 2 days ago

Verified 3bd9c491

[docker] Restructure Dockerfile for more efficient and cache-friendly builds (#30626)

amrmahdi committed 2 days ago

Verified ff21a0fc

[Bugfix] fix streaming final output for non harmony (#30237)

penfree committed 2 days ago

Verified bbd850e5

[BUILD] use sm_100f when compiling flashmla to fix support on sm103 (#30705)

Harry-Chen committed 2 days ago

Verified 511e81e7

[UX][Attention] Add `attention_config` argument to `LLM()` (#30710)

MatthewBonanni committed 2 days ago

Verified a182be43

[Benchmarks] `auto_tune.sh`: Use hostname variable for server requests (#30529)

KevinMusgrave committed 2 days ago

Verified c01d5898

Update batch invariant to use attention config (#30704)

MatthewBonanni committed 2 days ago

Verified 60dbf7d8

[Bugfix] Fail instead of ignoring when CompilationConfig gets invalid args (#30708)

mgoin committed 2 days ago

Verified a450c64a

[docs][fix] Update Arm CPU vLLM wheel installation docs (#30594)

fadara01 committed 2 days ago

Verified b2191abd

[Bugfix] Fix ViT with FlashAttention on ROCm (#30703)

MatthewBonanni committed 2 days ago

Verified 51e5b3e3

[Platform] Refactor Platform attention backend selection to avoid breakpoint for OOT platform (#30212)

Isotr0py committed 2 days ago

Verified ec154c36

Older