vllm-project/vllm

Pull Requests Commits

[Bugfix] Disable w16a16 2of4 sparse CompressedTensors24 (#12417)

tlrmchlsmth committed 325 days ago

Verified aa2cd2c4

[Frontend] generation_config.json for maximum tokens(#12242)

mhendrey committed 325 days ago

Verified 9ddc3522

[Misc] Revert FA on ViT #12355 and #12435 (#12445)

ywang96 committed 325 days ago

Verified a5255270

[V1][Bugfix] Fix assertion when mm hashing is turned off (#12439)

ywang96 committed 325 days ago

Verified 0ee349b5

[V1][Perf] Reduce scheduling overhead in model runner after cuda sync (#12094)

youngkent committed 325 days ago

Verified fa63e710

[Misc][Bugfix] FA3 support to ViT MHA layer (#12435)

ywang96 committed 325 days ago

Verified 2a0309a6

[TPU][CI] Update torchxla version in requirement-tpu.txt (#12422)

lsy323 committed 326 days ago

Verified 324960a9

[Misc] Add FA2 support to ViT MHA layer (#12355)

Isotr0py committed 326 days ago

Verified f1fc0510

[ROCm][MoE] MI300 tuned configs Mixtral-8x(7B,22B) | fp16, fp8 (#12408)

divakar-amd committed 326 days ago

Verified bf21481d

[Bugfix] Fix BLIP-2 processing (#12412)

DarkLight1337 committed 326 days ago

Verified fb30ee92

[Bugfix][Kernel] Fix moe align block issue for mixtral (#12413)

ElizaWszola committed 326 days ago

Verified 221d388c

[Bugfix][Kernel] FA3 Fix - RuntimeError: This flash attention build only supports pack_gqa (for build size reasons). (#12405)

LucasWilkinson committed 327 days ago

Verified 3132a933

[Misc] Remove deprecated code (#12383)

DarkLight1337 committed 327 days ago

Verified df5dafaa

[Bugfix][Kernel] Fix CUDA 11.8 being broken by FA3 build (#12375)

LucasWilkinson committed 327 days ago

Verified ab5bbf5a

[Misc] Enable proxy support in benchmark script (#12356)

jsato8094 committed 327 days ago

Verified 3bb8e2c9

[ci/build] sync default value for wheel size (#12398)

youkaichao committed 327 days ago

Verified e784c6b9

[Hardware][Gaudi][Doc] Add missing step in setup instructions (#12382)

MohitIntel committed 327 days ago

Verified 9a0f3bdb

[ci/build] fix wheel size check (#12396)

youkaichao committed 327 days ago

Verified c7c98510

[Misc] Use VisionArena Dataset for VLM Benchmarking (#12389)

ywang96 committed 327 days ago

Verified 3c818bdb

[perf] fix perf regression from #12253 (#12380)

youkaichao committed 327 days ago

Verified 6dd94dbe

[V1] Increase default batch size for H100/H200 (#12369)

WoosukKwon committed 327 days ago

Verified 0e74d797

Update compressed-tensors version (#12367)

dsikka committed 327 days ago

Verified 55ef66ed

[Bugfix] Path join when building local path for S3 clone (#12353)

omer-dayan committed 327 days ago

Verified 5e5630a4

Set weights_only=True when using torch.load() (#12366)

russellb committed 327 days ago

Verified d3d6bb13

[V1][Frontend] Coalesce bunched `RequestOutput`s (#12298)

njhill committed 327 days ago

Verified 24b0205f

[Docs] Update spec decode + structured output in compat matrix (#12373)

russellb committed 327 days ago

Verified c5cffcd0

[Docs] Add meetup slides (#12345)

WoosukKwon committed 328 days ago

Verified 682b55bc

[Misc] Fix OpenAI API Compatibility Issues in Benchmark Script (#12357)

jsato8094 committed 328 days ago

Verified 9726ad67

[BugFix] Fix parameter names and `process_after_weight_loading` for W4A16 MoE Group Act Order (#11528)

dsikka committed 328 days ago

Verified eb5cb5e5

[Docs] Document Phi-4 support (#12362)

Isotr0py committed 328 days ago

Verified 2cbeedad

Newer Older