Commits vllm-project/vllm

Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199)

DarkLight1337 committed 1 day ago

Verified e83b7e37

[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)

DarkLight1337 committed 2 days ago

Verified 27f4c2fd

Lazy loading to avoid importing all files (#29716)

yongming-qin committed 2 days ago

Verified a49d813f

[Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558)

yewentao256 committed 2 days ago

Verified 17eb25e3

Support multiple image/audio embeddings per requests (#29988)

jeremyteboul committed 2 days ago

Verified dce6d229

[Frontend] Remove confusing -O.xx flag error (#30169)

gmagogsfm committed 2 days ago

Verified cbedb703

[MISC]: change NIXL compatibility hash logging level to debug (#30182)

AuruTus committed 2 days ago

Verified 8d3da4c7

[ez] move harmony utils to parser folder (#30117)

qandrew committed 2 days ago

Verified 421125d0

Merge branch 'main' into wentao-fix-torch-warning

yewentao256 committed 2 days ago

Verified 97780339

[Model] Move `multimodal_cpu_fields` definition to field config (#30181)

DarkLight1337 committed 2 days ago

Verified 671427ef

Gigachat 3 tool parser and tests (#29905)

ajpqs committed 2 days ago

Verified 21bb3235

simplify requires_files list creation (#29656)

nwaughachukwuma committed 2 days ago

Verified 17a9abec

[Misc] Fix circular import in vllm.transformers_utils.config (#30179)

yeqcharlotte committed 2 days ago

Verified 92c35abb

Support tokenization_kwargs override (#29794)

piood committed 2 days ago

Verified 43e75930

[Chore] Deprecate `SupportsMultiModal.merge_by_field_config` (#30170)

DarkLight1337 committed 2 days ago

Verified c46b932d

prefix caching design doc sha256 now default (#29261)

redwrasse committed 3 days ago

Verified 64763823

[bugfix] fix type[AttentionBackend] bug in kv_connector_base_v1 (#30051)

HF-001 committed 3 days ago

Verified d6aeaddf

[Model Runner V2] Support min-p sampling (#30171)

WoosukKwon committed 3 days ago

Verified a238cbd8

[Misc] Move `disable_nccl_for_dp_synchronization` init logic into `VllmConfig` (#30161)

njhill committed 3 days ago

Verified 4026ae31

[CI/Build][AMD] Use ROCM_ATTN instead of FLASH_ATTN test for test_register_kv_caches for ROCm and update test for TRITON_ATTN (#29985)

rasmith committed 3 days ago

Verified b12f4a98

[Bugfix]: Fix `TokenizerLike` interface (#30009)

Rohan138 committed 3 days ago

Verified 40a046cd

[Model] Add support for transformer-based Ultravox v0.7 projector (#30089)

petersalas committed 3 days ago

Verified e858bc4d

fix#30092 Kimi-Linear model loading failure with missing indexer_rotary_emb (#30093)

baonudesifeizhai committed 3 days ago

Verified e3fbb6f1

Fix AWQ MoE marlin check issue in marlin_utils.py for AMD backend (#30102)

yuttian1 committed 3 days ago

Verified c4d62618

[CI/Build][AMD] Skip marlin, machete, and hadacore tests since these require _C functions not defined for ROCm (#30109)

rasmith committed 3 days ago

Verified 62079d86

Better error when world size is larger than node and `distributed_executor_backend` is not set (#30140)

hmellor committed 3 days ago

Verified bf4a901a

[CI]: Remove unnecessary imports from test_lmache_integration (#30157)

sammshen committed 3 days ago

Verified 7e31c3a3

[CI/Build][AMD][Quantization] Fix test_int8_kernel.py by updating int8_utils to use hip.libdevice.round (#30151)

rasmith committed 3 days ago

Verified dc839ad0

[Tests] Tool call tests for openai/gpt-oss-20b (#26237)

debroy-rh committed 3 days ago

Verified 02a41691

default not change

yewentao256 committed 3 days ago

5bc9eaf6