vllm-project/vllm

Pull Requests Commits

tlrmchlsmth committed 1 year ago

87e47eb1

[Misc] Human-readable `max-model-len` cli arg (#16181)

NickLucche committed 1 year ago

Verified 090c856d

Print the warning only once (#16193)

gshtras committed 1 year ago

Verified ad434d4c

[V1] Revert the default `max_num_seqs` to V0 values for most hardware (#16158)

DarkLight1337 committed 1 year ago

Verified 66d433b9

[Bugfix] Re-enable support for `ChatGLMForConditionalGeneration` (#16187)

DarkLight1337 committed 1 year ago

Verified 027b204f

Upstream Llama4 Support to Main (#16113)

houseroad committed 1 year ago

Verified 55dcce91

[Doc]Update image to latest version (#16186)

WangErXiao committed 1 year ago

Verified 8017c8db

[Misc] improve example mlpspeculator and llm_engine_example (#16175)

reidliu41 committed 1 year ago

Verified dc3529db

[Model] Add Qwen3 and Qwen3MoE (#15289)

YamPengLi committed 1 year ago

Verified 7699258e

[V1][Structured Output] Add `supports_structured_output()` method to Platform (#16148)

shen-shanshan committed 1 year ago

Verified e9ba99f2

[VLM] Florence-2 supports online serving (#16164)

Isotr0py committed 1 year ago

Verified 7c803687

doc: fix some typos in doc (#16154)

yihong0618 committed 1 year ago

Verified 95d63f38

[CI] Set max transformers version for Ultravox model test (#16149)

ywang96 committed 1 year ago

Verified bb8dab82

[Bugfix] Make dummy encoder prompt padding alternative and add missing warnings (#16129)

Isotr0py committed 1 year ago

Verified fc0f8776

[Misc] Update Mistral-3.1 example (#16147)

DarkLight1337 committed 1 year ago

Verified 0a573867

[V1][Minor] Minor simplification for get_computed_blocks (#16139)

WoosukKwon committed 1 year ago

Verified 3749e287

[Metrics] Add bucket for `request_latency`, `time_to_first_token` and `time_per_output_token` (#15202)

yankay committed 1 year ago

Verified 86fc2321

Fix requires-python (#16132)

martinhoyer committed 1 year ago

Verified 2549c0df

[V1][Minor] Optimize get_cached_block (#16135)

WoosukKwon committed 1 year ago

Verified b10e5198

[TPU] Update PyTorch/XLA (#16130)

yaochengji committed 1 year ago

Verified 9bde5ba1

[Misc] update requires-python in pyproject.toml (#16116)

reidliu41 committed 1 year ago

Verified 72c8f1ad

[Bugfix] add hf_token to EngineArgs (#16093)

paolovic committed 1 year ago

Verified da224daa

[Bugfix] LoRA : Fix the order in which the kernels process LoRAs (#16040)

varun-sundar-rabindranath committed 1 year ago

Verified 3a100b92

[Model] use AutoWeightsLoader for stablelm,starcoder2,zamba2 (#16103)

lengrongfu committed 1 year ago

Verified 242a637a

[Misc] Improve model redirect to accept json dictionary (#16119)

Isotr0py committed 1 year ago

Verified c2a96715

[Doc][Bugfix] Add missing EOF in k8s deploy doc (#16025)

psschwei committed 1 year ago

Verified d5ae4f7f

[Misc] refactor example eagle (#16100)

reidliu41 committed 1 year ago

Verified b6c502a1

[CI][V1] Fix passing `tokenizer` as kwarg to `validate_guidance_grammar` (#16117)

ywang96 committed 1 year ago

Verified 9ca710e5

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

bjj committed 1 year ago

Verified eb07c8cb

[Benchmark] Add sampling parameters to benchmark_serving. (#16022)

hyeygit committed 1 year ago

Verified ba108019

Older