vllm-project/vllm

Pull Requests Commits

[V1][Minor] Remove outdated comment (#12968)

WoosukKwon committed 307 days ago

Verified 870c3748

[VLM] Merged multi-modal processor for GLM4V (#12449)

jeejeelee committed 307 days ago

Verified 86222a3d

[bugfix] fix early import of flash attention (#12959)

youkaichao committed 307 days ago

Verified fe743b79

[Bugfix] Remove unused seq_group_metadata_list from ModelInputForGPU (#12935)

ShangmingCai committed 307 days ago

Verified 913df14d

[CI/Build] Auto-fix Markdown files (#12941)

DarkLight1337 committed 307 days ago

Verified 8a69e0e2

[Misc] Add qwen2.5-vl BNB support (#12944)

Isotr0py committed 307 days ago

Verified 4c8dd12e

[Doc] Correct HF repository for TeleChat2 models (#12949)

waltforme committed 307 days ago

Verified 256a2d29

[CI] Resolve transformers-neuronx version conflict (#12925)

liangfu committed 307 days ago

Verified c45d398e

[Misc] Log time consumption on weight downloading (#12926)

waltforme committed 307 days ago

Verified 011e612d

[misc] Add LoRA to benchmark_serving (#12898)

varun-sundar-rabindranath committed 307 days ago

Verified 7e183767

[Hardware][Intel-Gaudi] Enable long-contexts + LoRA support for Intel Gaudi (#12812)

scsudhak-intel committed 307 days ago

Verified 2880e21e

[Build] Make pypi install work on CPU platform (#12874)

wangxiyuan committed 307 days ago

Verified 407b5537

[V1][Minor] Move cascade attn logic outside _prepare_inputs (#12943)

WoosukKwon committed 308 days ago

Verified 4ea48fb3

[Misc] Add offline test for disaggregated prefill (#12418)

Shaoting-Feng committed 308 days ago

Verified e31498bd

[bugfix] respect distributed_executor_backend in world_size=1 (#12934)

youkaichao committed 308 days ago

Verified 91dd8f7a

[Bugfix] Fix multi-round chat error when mistral tokenizer is used (#12859)

zifeitong committed 308 days ago

Verified d01f66b0

[Misc] Fix typo in the example file (#12896)

DK-DARKmatter committed 308 days ago

Verified cc01223f

[Bugfix] Fix Qwen2_5_VLForConditionalGeneration packed_modules_mapping (#12905)

jeejeelee committed 308 days ago

Verified 306923da

[V1] Move KV block hashes from Request to KVCacheManager (#12922)

WoosukKwon committed 308 days ago

Verified 32431583

[V1][Minor] Remove outdated comment (#12928)

WoosukKwon committed 308 days ago

Verified b21f0f9d

[Bugfix] Fix disagg hang caused by the prefill and decode communication issues (#12723)

houseroad committed 308 days ago

Verified 45cbc499

[V1] LM Eval With Streaming Integration Tests (#11590)

robertgshaw2-redhat committed 308 days ago

Verified 932c6b74

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)

tjtanaa committed 308 days ago

Verified eaa92d44

[V1] Logprobs and prompt logprobs support (#9880)

afeldman-nm committed 308 days ago

Verified 0630d453

PR #12718 (#12718)

garg-amit committed 308 days ago

Verified 538fab93

[Misc] Remove unnecessary detokenization in multimodal processing (#12868)

DarkLight1337 committed 308 days ago

Verified ce26b162

[MISC][EASY] Break check file names into entry and args in the pre-commit hooks (#12880)

houseroad committed 308 days ago

Verified 1918aa1b

Prevent unecessary requests to huggingface hub (#12837)

maxdebayser committed 309 days ago

Verified 6e1fc61f

[Bugfix] Missing quant_config in deepseek embedding layer (#12836)

SzymonOzog committed 309 days ago

Verified aa375dca

Make vllm compatible with verl (#12824)

ZSL98 committed 309 days ago

Verified 433c4a49

Newer Older