vllm-project/vllm

Pull Requests Commits

[Bug] Fix a corner case in _process_simple_streaming_events (#34754)

842974287 committed 84 days ago

Verified 8e87cc57

[Misc] Rename `group_mm_kwargs_by_modality -> group_and_batch_mm_kwargs` (#36158)

DarkLight1337 committed 84 days ago

Verified 6dd30265

[Bugfix] Fix simple Mistral-Small example (#36156)

DarkLight1337 committed 84 days ago

Verified de00ebea

[ROCm][CI] Adding missing dependencies for Multi-modal models tests (#36177)

AndreasKaratzas committed 84 days ago

Verified 639680d2

Reenable features for ROCm attention backends (#36185)

Rohan138 committed 84 days ago

Verified c5362c73

cpu: aarch64: Upgrade OneDNN for aarch64 to add support for int8 matmul (#36147)

nikhil-arm committed 84 days ago

Verified 0a49676f

Don't fire ray compatibility webhook when PR or branch is not provided (#36088)

jeffreywang-anyscale committed 84 days ago

Verified c012a8c4

[Performance] Extract KV-cache update from TreeAttention backend (#35384)

dorhuri123 committed 84 days ago

Verified ebed80a7

[Model Runner V2] Fix warmup for very small kvcache and/or blocksizes (#36176)

njhill committed 84 days ago

Verified a73af584

[compile] Consistent compiler config for saved/loaded vllm backends. (#35810)

zhxchen17 committed 85 days ago

Verified a97954b6

[Model] Add support for OLMo Hybrid (#32550)

yanhong-lbh committed 85 days ago

Verified a911f4dd

[CI] Add explicit permissions to macOS smoke test workflow (#35775)

russellb committed 85 days ago

Verified 5395471d

[BugFix] Fallback from FA4->FA2 for Batch Invariance (#36059)

frankwang28 committed 85 days ago

Verified a57c877f

[Perf] Optimize FusedMoEModularKernel output tensor using torch.empty (#35794)

xyang16 committed 85 days ago

Verified f9170209

[Bugfix] Disable FlashInfer TRTLLM BF16 path for non-gated MoE (#36146)

tomeras91 committed 85 days ago

Verified 86483ca7

ParakeetProjection.norm = RMSNorm instead of nn.LayerNorm (#36133)

netanel-haber committed 85 days ago

Verified b93a9e6f

[XPU] Enable ModelRunnerV2 on XPU (#36078)

xinyu-intel committed 85 days ago

Verified d8839ef7

[BUGFIX]Fix Qwen-Omni models audio max_token_per_item estimation error leading to encoder_cache_size is 0 (#35994)

jjmiao1 committed 85 days ago

Verified e998fa76

[Bugfix][CI] fix typos (#34934)

1195343015 committed 85 days ago

Verified 6a895197

[ROCm] Refactor ROCm attention backend selection logic (#35246)

SageMoore committed 85 days ago

Verified 8c760b6a

refactor funasr model. (#36108)

AllenDou committed 85 days ago

Verified 3ee68590

[Bugfix] Fix Qwen-VL tokenizer implementation (#36140)

DarkLight1337 committed 85 days ago

Verified 71963481

[openai api] log exception in exception handler (1/N) (#31164)

andyxning committed 85 days ago

Verified 176c799f

[KVConnector] Scheduler: Fix num_computed_tokens after async KV load (#34616)

orozery committed 85 days ago

Verified 612e7729

Fix import that was moved in Transformers 5.2.0 (#36120)

hmellor committed 85 days ago

Verified ecde7af9

[Docs] Only build docs if `documentation` or `ready` labels are present (#36135)

hmellor committed 85 days ago

Verified 8df52335

[CI] Stabilize test_no_args_tool_call and add ROCm-specific server args (#36107)

AndreasKaratzas committed 85 days ago

Verified b03ff6a9

[Bugfix] Fix RunAI streamer crash with S3-hosted model paths (#35976)

AjAnubolu committed 85 days ago

Verified ed81d5ed

[Bugfix] Fix mypy errors in hermes_tool_parser.py (#36114)

842974287 committed 85 days ago

Verified 3c23ac84

[Misc] Fix SyntaxWarning - invalid escape sequence '\e' (#36020)

cjackal committed 85 days ago

Verified a708ef59

Newer Older