vllm-project/vllm

Pull Requests Commits

Updates docs with correction about default cuda version

mgoin committed 1 year ago

Verified c1d1875b

[Doc]Add documentation for using EAGLE in vLLM (#11417)

sroy745 committed 1 year ago

Verified 973f5dc5

[Bugfix] update the prefix for qwen2 (#11795)

jiangjiadi committed 1 year ago

Verified c994223d

[optimization] remove python function call for custom op (#11750)

youkaichao committed 1 year ago

Verified 869579a7

[Doc] Add note to `gte-Qwen2` models (#11808)

DarkLight1337 committed 1 year ago

Verified c0efe92d

[doc] update how pip can install nightly wheels (#11806)

youkaichao committed 1 year ago

Verified d9fa1c05

[V1] Support audio language models on V1 (#11733)

ywang96 committed 1 year ago

Verified 2de197bd

[doc] add doc to explain how to use uv (#11773)

youkaichao committed 1 year ago

Verified 869e829b

[Bugfix] Comprehensively test and fix LLaVA-NeXT feature size calculation (#11800)

DarkLight1337 committed 1 year ago

Verified 8f37be38

[V1][Doc] Update V1 support for `LLaVa-NeXT-Video` (#11798)

ywang96 committed 1 year ago

Verified 8082ad79

[CI][CPU] adding build number to docker image name (#11788)

zhouyuan committed 1 year ago

Verified 1e4ce295

[Doc] Create a vulnerability management team (#9925)

russellb committed 1 year ago

Verified ce1917fc

fix init error for MessageQueue when n_local_reader is zero (#11768)

XiaobingSuper committed 1 year ago

Verified e512f76a

[CI] Fix neuron CI and run offline tests (#11779)

liangfu committed 1 year ago

Verified 898cdf03

[Bugfix] Update attention interface in `Whisper` (#11784)

ywang96 committed 1 year ago

Verified 0f3f3c86

[Kernel][LoRA]Punica prefill kernels fusion (#11234)

jeejeelee committed 1 year ago

Verified b2785579

[Doc][3/N] Reorganize Serving section (#11766)

DarkLight1337 committed 1 year ago

Verified 8ceffbf3

[XPU] Make pp group initilized for pipeline-parallelism (#11648)

ys950902 committed 1 year ago

Verified d93d2d74

[Model] Future-proof Qwen2-Audio multi-modal processor (#11776)

DarkLight1337 committed 1 year ago

Verified d0169e1b

[Bugfix] Fix LLaVA-NeXT feature size precision error (for real) (#11772)

DarkLight1337 committed 1 year ago

Verified 08fb75c7

[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)

ywang96 committed 1 year ago

Verified 91b361ae

[Kernel] Move attn_type to Attention.__init__() (#11690)

heheda12345 committed 1 year ago

Verified e20c92bb

[Bugfix][V1] Fix molmo text-only inputs (#11676)

jeejeelee committed 1 year ago

Verified 32c9eff2

[doc] explain how to add interleaving sliding window support (#11771)

youkaichao committed 1 year ago

Verified 4ca5d40a

[Bugfix] Fix max image size for LLaVA-Onevision (#11769)

ywang96 committed 1 year ago

Verified 9279b9f8

[Doc][2/N] Reorganize Models and Usage sections (#11755)

DarkLight1337 committed 1 year ago

Verified ee77fdb5

[VLM] Separate out profiling-related logic (#11746)

DarkLight1337 committed 1 year ago

Verified 996357e4

k8s-config: Update the secret to use stringData (#11679)

surajssd committed 1 year ago

Verified 2a622d70

[mypy] Forward pass function type hints in lora (#11740)

lucas-tucker committed 1 year ago

Verified 9c749713

[V1] Refactor get_executor_cls (#11754)

ruisearch42 committed 1 year ago

Verified 022c5c69

Older