vllm-project/vllm

Pull Requests Commits

WoosukKwon committed 37 days ago

99e03590

WoosukKwon committed 37 days ago

b48ad7bb

implement with UVA

WoosukKwon committed 37 days ago

486c5e99

Merge branch 'main' into woosuk/v2-penalties

WoosukKwon committed 38 days ago

2431d5c3

[Model Runner V2][BugFix] Keep reference to GPU tensors in AsyncOutput (#29623)

WoosukKwon committed 38 days ago

Verified ae0ce1be

[BugFix] Fix `plan` API Mismatch when using latest FlashInfer (#29426)

askliar committed 38 days ago

Verified a5345bf4

[CI] Add batched audios Whisper test (#29308)

NickLucche committed 38 days ago

Verified e5a621b7

[Bugfix][MM encoder] Fix ViT attention backend resolving for Turing GPU (#29614)

Isotr0py committed 38 days ago

Verified 38658ec6

[Deprecation] Advance deprecation status (#29617)

DarkLight1337 committed 38 days ago

Verified a24ea541

[Misc] Remove unused code from `protocol.py` (#29616)

DarkLight1337 committed 38 days ago

Verified ea228b44

[Model Runner V2] Add sampling penalties

WoosukKwon committed 38 days ago

6874e842

add skip_reading_prefix_cache in repr for PoolingParams (#29620)

guodongxiaren committed 38 days ago

Verified d45269b3

[Bugfix] Fix doc build on main (#29619)

DarkLight1337 committed 38 days ago

Verified ee9841da

[BugFix] Optional tokenizer argument when loading GGUF models (#29582)

sts07142 committed 38 days ago

Verified 0840abdd

Update Transformers pin in CI to 4.57.3 (#29418)

hmellor committed 38 days ago

Verified e1f26233

[Attention] Update attention imports (#29540)

MatthewBonanni committed 38 days ago

Verified fc1d8be3

[bugfix] avoid NIXL_ERR_REMOTE_DISCONNECT in nixl_connector when Prefill dies (#28120)

hasB4K committed 38 days ago

Verified cd007a53

[Doc]: fixing typos in diverse files (#29492)

didier-durand committed 38 days ago

Verified 66d3d542

[CI/Build] Skip ray tests on ROCm (#29556)

rjrock committed 38 days ago

Verified bab438ff

[CI/Build][Bugfix] Fix auto label issues for CPU (#29610)

bigPYJ1151 committed 38 days ago

Verified 882851dc

[LoRA] Continue optimizing MoE LoRA weight loading (#29322)

jeejeelee committed 38 days ago

Verified 2f5f9acd

[Bugfix] Fix HunyuanVL XD-RoPE (#29593)

ywang96 committed 39 days ago

Verified cf348c8d

[CI] Auto label CPU related issues (#29602)

bigPYJ1151 committed 39 days ago

Verified a5abd1d3

[Bugfix] Fix pre-commit (#29601)

DarkLight1337 committed 39 days ago

Verified e6d4f3c2

[Docs] Improve `priority` parameter documentation (#29572)

maang-h committed 39 days ago

Verified 51906c8c

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): Set up -O infrastructure (#26847)

morrison-turnansky committed 39 days ago

Verified 0838b52e

[Bugfix] Update Ultravox compatibility (#29588)

DarkLight1337 committed 39 days ago

Verified 00d3310d

[Model Runner V2] Implement multi-step Eagle with CUDA graph (#29559)

WoosukKwon committed 39 days ago

Verified da3222f3

[ROCm][CI] Fix test_cpu_offloading for ROCm (#29548)

micah-wil committed 39 days ago

Verified 43c57925

Fix tpu-inference platform path (#29554)

jcyang43 committed 39 days ago

Verified 3ecabd06

Older