vllm-project/vllm

Pull Requests Commits

WoosukKwon committed 118 days ago

fefed35c

WoosukKwon committed 118 days ago

901afda9

[Misc] Minor code simplification for spec decode (#24053)

WoosukKwon committed 118 days ago

Verified 39a22dca

Document multi-proc method selection for profiling (#23802)

hypdeb committed 118 days ago

Verified 41c80698

[Model]: support KeyeVL-1_5-8B (#23838)

Kwai-Keye committed 118 days ago

Verified 7c8271cd

[Doc]: Fix CPU install docs: force torch-backend=cpu to avoid GPU torchvision errors (#24033)

yankay committed 118 days ago

Verified 3e330fcb

[Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735)

NickLucche committed 118 days ago

Verified d46934b2

[Doc]: fix typos in Python comments (#24026)

didier-durand committed 118 days ago

Verified 10728495

[Kernel] Update DeepGEMM to latest commit (#23915)

jeejeelee committed 118 days ago

Verified dc1a5318

[Frontend] Update the warning log when using VLLM_ALLOW_LONG_MAX_MODEL_LEN (#20904)

noooop committed 118 days ago

Verified 55602bb2

[Misc] Enable V1 FP16 inference on pre-Ampere GPUs (#24022)

Isotr0py committed 118 days ago

Verified d7fbc6dd

[Misc] add hash_function doc string (#24014)

andyxning committed 118 days ago

Verified 5438967f

[Bugfix] Add support for `<tool_call>` format in streaming mode for XLAM Tool Parser (#22769)

DevonPeroutky committed 118 days ago

Verified 422e793f

[Misc] IO Processor plugins for pooling models (#22820)

christian-pinto committed 118 days ago

Verified 1cb39dbc

Migrate Phi4 inputs to TensorSchema (#23471)

bbeckca committed 118 days ago

Verified 437c3ce0

[Misc] refactor code by import as for torch._inductor.config (#23677)

andyxning committed 118 days ago

Verified 499b074b

[CI/Build] Improve Tensor Schema tests speed by avoid engine core initialization (#23357)

Isotr0py committed 118 days ago

Verified ff0e59d8

[Misc] Move fast prefill logic to separate method (#24013)

WoosukKwon committed 118 days ago

Verified b5571368

Fix the bug related to loading GPTP INT3 weights. (#23328)

Jun-Howie committed 118 days ago

Verified acc1a6e1

[Misc] Avoid redundant copy for encoder-only models (#24012)

WoosukKwon committed 119 days ago

Verified 8c742a66

[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and AutoRound-GPTQ) (#23994)

JartX committed 119 days ago

Verified 183a7096

v1: Support KV events from connectors (#19737)

orozery committed 119 days ago

Verified 14b4326b

[Minor] Fix some random typos in comments (#24009)

njhill committed 119 days ago

Verified 752d2e1c

vllm fix check on max vocab size (#22471)

xw285cornell committed 119 days ago

Verified 81eea3d3

[Doc]: fix typos in Python comments (#24001)

didier-durand committed 119 days ago

Verified 9701352e

[Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394)

ywang96 committed 120 days ago

Verified 749be00a

Fix wrong truncate_prompt_tokens type hint (#22761)

gmarinho2 committed 120 days ago

Verified 5b8077b8

[LoRA] Much faster startup when LoRA is enabled (#23777)

andylolu2 committed 120 days ago

Verified 038e9be4

[Misc] enhance type hint for rearrange return value (#23519)

andyxning committed 120 days ago

Verified 68a34911

[Refactor] refactor freezing_value/cuda_event initialize outside try finally (#23758)

andyxning committed 120 days ago

Verified e80bca30

Older