vllm-project/vllm

Pull Requests Commits

compilation is fixed

alexm-redhat committed 1 year ago

70b4e46e

fix capture model

alexm-redhat committed 1 year ago

5fb9dbe6

alexm-redhat committed 1 year ago

996b92cc

alexm-redhat committed 1 year ago

2b0526fa

alexm-redhat committed 1 year ago

7be64925

alexm-redhat committed 1 year ago

627efde8

Optimize decode/prompt prepare code

alexm-redhat committed 1 year ago

c2867d5b

review comments

alexm-redhat committed 1 year ago

39c4a4cd

alexm-redhat committed 1 year ago

1ccf100c

alexm-redhat committed 1 year ago

248c5b63

scheduler is clean

alexm-redhat committed 1 year ago

950f3494

Chunked prompt works!

alexm-redhat committed 1 year ago

61bb55f3

alexm-redhat committed 1 year ago

0bddb6b9

[V1] TPU support

alexm-redhat committed 1 year ago

c715fb19

[V1][Frontend] Coalesce bunched `RequestOutput`s (#12298)

njhill committed 1 year ago

Verified 24b0205f

[Docs] Update spec decode + structured output in compat matrix (#12373)

russellb committed 1 year ago

Verified c5cffcd0

[Docs] Add meetup slides (#12345)

WoosukKwon committed 1 year ago

Verified 682b55bc

[Misc] Fix OpenAI API Compatibility Issues in Benchmark Script (#12357)

jsato8094 committed 1 year ago

Verified 9726ad67

[BugFix] Fix parameter names and `process_after_weight_loading` for W4A16 MoE Group Act Order (#11528)

dsikka committed 1 year ago

Verified eb5cb5e5

[Docs] Document Phi-4 support (#12362)

Isotr0py committed 1 year ago

Verified 2cbeedad

[TPU] Update TPU CI to use torchxla nightly on 20250122 (#12334)

lsy323 committed 1 year ago

Verified 2c85529b

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

gshtras committed 1 year ago

Verified e97f802b

[torch.compile] decouple compile sizes and cudagraph sizes (#12243)

youkaichao committed 1 year ago

Verified 6e650f56

[core] add wake_up doc and some sanity check (#12361)

youkaichao committed 1 year ago

Verified 3f50c148

[Bugfix] Fix broken internvl2 inference with v1 (#12360)

Isotr0py committed 1 year ago

Verified 8c01b802

[V1] Simplify M-RoPE (#12352)

ywang96 committed 1 year ago

Verified 99d01a5e

[Doc] Troubleshooting errors during model inspection (#12351)

DarkLight1337 committed 1 year ago

Verified d07efb31

[Kernel] Flash Attention 3 Support (#12093)

LucasWilkinson committed 1 year ago

Verified 978b45f3

[Bugfix] Fix k_proj's bias for whisper self attention (#12342)

Isotr0py committed 1 year ago

Verified c5b4b11d

[Hardware][Gaudi][BugFix] Fix dataclass error due to triton package update (#12338)

zhenwei-intel committed 1 year ago

Verified 8ae5ff20

Older