vllm-project/vllm

Pull Requests Commits

review comments

alexm-redhat committed 1 year ago

39c4a4cd

alexm-redhat committed 1 year ago

1ccf100c

alexm-redhat committed 1 year ago

248c5b63

scheduler is clean

alexm-redhat committed 1 year ago

950f3494

Chunked prompt works!

alexm-redhat committed 1 year ago

61bb55f3

alexm-redhat committed 1 year ago

0bddb6b9

[V1] TPU support

alexm-redhat committed 1 year ago

c715fb19

[V1][Frontend] Coalesce bunched `RequestOutput`s (#12298)

njhill committed 1 year ago

Verified 24b0205f

[Docs] Update spec decode + structured output in compat matrix (#12373)

russellb committed 1 year ago

Verified c5cffcd0

[Docs] Add meetup slides (#12345)

WoosukKwon committed 1 year ago

Verified 682b55bc

[Misc] Fix OpenAI API Compatibility Issues in Benchmark Script (#12357)

jsato8094 committed 1 year ago

Verified 9726ad67

[BugFix] Fix parameter names and `process_after_weight_loading` for W4A16 MoE Group Act Order (#11528)

dsikka committed 1 year ago

Verified eb5cb5e5

[Docs] Document Phi-4 support (#12362)

Isotr0py committed 1 year ago

Verified 2cbeedad

[TPU] Update TPU CI to use torchxla nightly on 20250122 (#12334)

lsy323 committed 1 year ago

Verified 2c85529b

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

gshtras committed 1 year ago

Verified e97f802b

[torch.compile] decouple compile sizes and cudagraph sizes (#12243)

youkaichao committed 1 year ago

Verified 6e650f56

[core] add wake_up doc and some sanity check (#12361)

youkaichao committed 1 year ago

Verified 3f50c148

[Bugfix] Fix broken internvl2 inference with v1 (#12360)

Isotr0py committed 1 year ago

Verified 8c01b802

[V1] Simplify M-RoPE (#12352)

ywang96 committed 1 year ago

Verified 99d01a5e

[Doc] Troubleshooting errors during model inspection (#12351)

DarkLight1337 committed 1 year ago

Verified d07efb31

[Kernel] Flash Attention 3 Support (#12093)

LucasWilkinson committed 1 year ago

Verified 978b45f3

[Bugfix] Fix k_proj's bias for whisper self attention (#12342)

Isotr0py committed 1 year ago

Verified c5b4b11d

[Hardware][Gaudi][BugFix] Fix dataclass error due to triton package update (#12338)

zhenwei-intel committed 1 year ago

Verified 8ae5ff20

[doc] explain common errors around torch.compile (#12340)

youkaichao committed 1 year ago

Verified 51162744

[V1] Add `uncache_blocks` (#12333)

comaniac committed 1 year ago

Verified f0ef3723

[Docs] Document vulnerability disclosure process (#12326)

russellb committed 1 year ago

Verified 7551a340

[Docs] Update FP8 KV Cache documentation (#12238)

mgoin committed 1 year ago

Verified 01a55941

[Bugfix] Fixing AMD LoRA CI test. (#12329)

Alexei-V-Ivanov-AMD committed 1 year ago

Verified 8d7aa9de

[AMD][Quantization] Add TritonScaledMMLinearKernel since int8 is broken for AMD (#12282)

rasmith committed 1 year ago

Verified 68c4421b

[Frontend][V1] Online serving performance improvements (#12287)

njhill committed 1 year ago

Verified aea94362

Older