vllm-project/vllm

Pull Requests Commits

[torch.compile] reorganize the cache directory to support compiling multiple models (#19064)

youkaichao committed 201 days ago

Verified d70bc7c0

use base version for version comparison (#19587)

BoyuanFeng committed 201 days ago

Verified ce688ad4

[Fix] The zip function in Python 3.9 does not have the strict argument (#19549)

princepride committed 201 days ago

Verified cefdb996

[Fix] bump mistral common to support magistral (#19533)

princepride committed 201 days ago

Verified ace5cdaf

[CPU] Refine default config for the CPU backend (#19539)

bigPYJ1151 committed 201 days ago

Verified 64587211

[Misc] Correct broken docs link (#19553)

Zerohertz committed 201 days ago

Verified bb4a0dec

[doc] fix incorrect link (#19586)

reidliu41 committed 201 days ago

Verified c707cfc1

[Doc] uses absolute links for structured outputs (#19582)

aarnphm committed 201 days ago

Verified 7b3c9ff9

[Bugfix] Fix EAGLE vocab embedding for multimodal target model (#19570)

zixi-qi committed 201 days ago

Verified c68698b3

[BugFix] : Fix Batched DeepGemm Experts (#19515)

varun-sundar-rabindranath committed 201 days ago

Verified e3b12667

Revert "[Build/CI] Add tracing deps to vllm container image (#15224)" (#19378)

kouroshHakha committed 201 days ago

Verified e6aab5de

[V1] Resolve failed concurrent structured output requests (#19565)

russellb committed 202 days ago

Verified c57bb199

[Doc] Unify structured outputs examples (#18196)

aarnphm committed 202 days ago

Verified dba68f91

[Bugfix] Enforce contiguous input for dynamic_per_token FP8/INT8 quant (#19452)

mgoin committed 202 days ago

Verified a3319f4f

[Misc] Turn MOE_DP_CHUNK_SIZE into an env var (#19506)

varun-sundar-rabindranath committed 202 days ago

Verified 9d880f59

[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)

ekagra-ranjan committed 202 days ago

Verified 017ef648

[doc] Make top navigation sticky (#19540)

reidliu41 committed 202 days ago

Verified 4b25ab14

[torch.compile][ROCm] Fuse quantization onto attention using a torch.compile pass (#16756)

ProExpertProg committed 202 days ago

Verified f98548b9

Fix TorchAOConfig skip layers (#19265)

mobicham committed 202 days ago

Verified 96846bb3

[Perf] Vectorize static / dynamic INT8 quant kernels (#19233)

yewentao256 committed 202 days ago

Verified b6efafd9

[V1][NixlConnector] Drop `num_blocks` check (#19532)

NickLucche committed 202 days ago

Verified 1129e2b1

[Doc] Add V1 column to supported models list (#19523)

DarkLight1337 committed 202 days ago

Verified c742438f

[Quantization] Improve AWQ logic (#19431)

jeejeelee committed 202 days ago

Verified 73e2e011

[Bugfix] Respect num-gpu-blocks-override in v1 (#19503)

jmswen committed 202 days ago

Verified c9280e63

[Bugfix][V1] Allow manual FlashAttention for Blackwell (#19492)

mgoin committed 202 days ago

Verified af09b3f0

[Security] Prevent new imports of (cloud)pickle (#18018)

russellb committed 202 days ago

Verified 4f6c42fa

Fix typo (#19525)

2niuhe committed 202 days ago

Verified dff68000

[AMD][Kernel][BugFix] fix test_rocm_compressed_tensors_w8a8 for rocm (#19509)

rasmith committed 202 days ago

Verified 2e090bd5

[BugFix] Handle missing sep_token for Qwen3-Reranker in Score API (#19522)

strutive07 committed 202 days ago

Verified 1b0b065e

[BugFix] Work-around incremental detokenization edge case error (#19449)

njhill committed 202 days ago

Verified d5bdf899

Newer Older