vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into wentao-optimize-startup-logs-4

yewentao256 committed 2 days ago

Verified 8a5a9dbe

[Model] Move `multimodal_cpu_fields` definition to field config (#30181)

DarkLight1337 committed 2 days ago

Verified 671427ef

Gigachat 3 tool parser and tests (#29905)

ajpqs committed 2 days ago

Verified 21bb3235

simplify requires_files list creation (#29656)

nwaughachukwuma committed 2 days ago

Verified 17a9abec

[Misc] Fix circular import in vllm.transformers_utils.config (#30179)

yeqcharlotte committed 2 days ago

Verified 92c35abb

Support tokenization_kwargs override (#29794)

piood committed 2 days ago

Verified 43e75930

[Chore] Deprecate `SupportsMultiModal.merge_by_field_config` (#30170)

DarkLight1337 committed 2 days ago

Verified c46b932d

prefix caching design doc sha256 now default (#29261)

redwrasse committed 2 days ago

Verified 64763823

[bugfix] fix type[AttentionBackend] bug in kv_connector_base_v1 (#30051)

HF-001 committed 2 days ago

Verified d6aeaddf

[Model Runner V2] Support min-p sampling (#30171)

WoosukKwon committed 2 days ago

Verified a238cbd8

[Misc] Move `disable_nccl_for_dp_synchronization` init logic into `VllmConfig` (#30161)

njhill committed 2 days ago

Verified 4026ae31

[CI/Build][AMD] Use ROCM_ATTN instead of FLASH_ATTN test for test_register_kv_caches for ROCm and update test for TRITON_ATTN (#29985)

rasmith committed 2 days ago

Verified b12f4a98

[Bugfix]: Fix `TokenizerLike` interface (#30009)

Rohan138 committed 2 days ago

Verified 40a046cd

[Model] Add support for transformer-based Ultravox v0.7 projector (#30089)

petersalas committed 2 days ago

Verified e858bc4d

fix#30092 Kimi-Linear model loading failure with missing indexer_rotary_emb (#30093)

baonudesifeizhai committed 2 days ago

Verified e3fbb6f1

Fix AWQ MoE marlin check issue in marlin_utils.py for AMD backend (#30102)

yuttian1 committed 2 days ago

Verified c4d62618

[CI/Build][AMD] Skip marlin, machete, and hadacore tests since these require _C functions not defined for ROCm (#30109)

rasmith committed 2 days ago

Verified 62079d86

Better error when world size is larger than node and `distributed_executor_backend` is not set (#30140)

hmellor committed 2 days ago

Verified bf4a901a

[CI]: Remove unnecessary imports from test_lmache_integration (#30157)

sammshen committed 2 days ago

Verified 7e31c3a3

[CI/Build][AMD][Quantization] Fix test_int8_kernel.py by updating int8_utils to use hip.libdevice.round (#30151)

rasmith committed 2 days ago

Verified dc839ad0

[Tests] Tool call tests for openai/gpt-oss-20b (#26237)

debroy-rh committed 2 days ago

Verified 02a41691

Merge branch 'main' into wentao-optimize-startup-logs-4

yewentao256 committed 3 days ago

6add39d6

[Bug] Fix vLLM config is not set error (#29999)

yewentao256 committed 3 days ago

Verified 7b5575fa

let draft model follow target model's config_format (#30152)

bangshengtang committed 3 days ago

Verified 77e44728

[Bugfix][llama4_eagle] Fix missing 'lm_head' attribute (#29926)

divakar-amd committed 3 days ago

Verified 962d7038

[CI] Re-use whisper_client for all tests (#30148)

NickLucche committed 3 days ago

Verified e23ca3a0

[Misc] Rename CohereForAI references to CohereLabs (#30147)

russellb committed 3 days ago

Verified 3633035a

[Enc-Dec] Fix OOT tokenizer issue (#30144)

NickLucche committed 3 days ago

Verified bff78310

[KVConnector][Feature] Support KV connector cache reset via /reset_prefix_cache (#27170)

ptovam committed 3 days ago

Verified adb31506

[Compile] Conditional compilation. Introduce compile_ranges (#24252)

ilmarkov committed 3 days ago

Verified 4e26d3b0

Older