vllm-project/vllm

Pull Requests Commits

change to greedy

LiuXiaoxuanPKU committed 1 year ago

af985d70

LiuXiaoxuanPKU committed 1 year ago

b484b795

LiuXiaoxuanPKU committed 1 year ago

8fcd4d18

LiuXiaoxuanPKU committed 1 year ago

50e27883

LiuXiaoxuanPKU committed 1 year ago

f0ca3a61

LiuXiaoxuanPKU committed 1 year ago

52808839

add datasets to benchmark_latency

LiuXiaoxuanPKU committed 1 year ago

90304003

[V1][Spec Decode] Remove deprecated spec decode config params (#15466)

ShangmingCai committed 1 year ago

Verified 239b7bef

[Bugfix] Check dimensions of multimodal embeddings in V1 (#15816)

DarkLight1337 committed 1 year ago

Verified 09e974d4

Upgrade `transformers` to `v4.50.3` (#13905)

hmellor committed 1 year ago

Verified e5ef4fa9

[Bugfix] Fix missing return value in load_weights method of adapters.py (#15542)

noc-turne committed 1 year ago

Verified 037bcd94

[Bugfix] Fix Crashing When Loading Modules With Batchnorm Stats (#15813)

alex-jw-brooks committed 1 year ago

Verified c2e7507a

[Model] Update support for NemotronNAS models (#15008)

Naveassaf committed 1 year ago

Verified 3aa2b6a6

[V1] Fully Transparent Implementation of CPU Offloading (#15354)

youkaichao committed 1 year ago

Verified 555aa219

fix: better install requirement for install in setup.py (#15796)

yihong0618 committed 1 year ago

Verified e7ae3bf3

Recommend developing with Python 3.12 in developer guide (#15811)

hmellor committed 1 year ago

Verified b932c048

[Feature][ROCm]Enable fusion pass for torch.compile on ROCm (#15050)

charlifu committed 1 year ago

Verified e8582945

[Benchmark] Update Vision Arena Dataset and HuggingFaceDataset Setup (#15748)

JenZhao committed 1 year ago

Verified effc5d24

[Misc] update the comments (#15780)

lcy4869 committed 1 year ago

Verified 18ed3132

[V1][Scheduler] Avoid calling `_try_schedule_encoder_inputs` for every request (#15778)

WoosukKwon committed 1 year ago

Verified 9b459eca

fix: Comments to English for better dev experience (#15768)

yihong0618 committed 1 year ago

Verified 70fedd0f

[Bugfix] Added `embed_is_patch` mask for fuyu model (#15731)

kylehh committed 1 year ago

Verified bb103b29

fix: lint fix a ruff checkout syntax error (#15767)

yihong0618 committed 1 year ago

Verified 248e76c4

[V1] Override `mm_counts` for dummy data creation (#15703)

DarkLight1337 committed 1 year ago

Verified 803d5c35

fix test_phi3v (#15321)

pansicheng committed 1 year ago

Verified 7fd8c0f8

[doc] update conda to usage link in installation (#15761)

reidliu41 committed 1 year ago

Verified 44c3a5ab

[Bugfix] Fix Mistral guided generation using xgrammar (#15704)

juliendenize committed 1 year ago

Verified 6909a762

[CI] xgrammar structured output supports Enum. (#15757)

chaunceyjiang committed 1 year ago

Verified 04553371

[Bugfix] Fix Mllama interleaved images input support (#15564)

Isotr0py committed 1 year ago

Verified 3c0ff914

[V1][Minor] Simplify rejection sampler's parse_output (#15741)

WoosukKwon committed 1 year ago

Verified 2bc4be4e

Older