vllm-project/vllm

Pull Requests Commits

ywang96 committed 1 year ago

0405645a

[Misc] fix typo: add missing space in lora adapter error message (#12564)

Beim committed 1 year ago

Verified 41bf5612

Set `?device={device}` when changing tab in installation guides (#12560)

hmellor committed 1 year ago

Verified a2769032

[V1][Metrics] Add GPU cache usage % gauge (#12561)

markmc committed 1 year ago

Verified f17f1d46

[Misc][MoE] add Deepseek-V3 moe tuning support (#12558)

divakar-amd committed 1 year ago

Verified 1c1bb0bb

[V1][BugFix] Free encoder cache for aborted requests (#12545)

WoosukKwon committed 1 year ago

Verified e0cc5f25

Revert "[Build/CI] Fix libcuda.so linkage" (#12552)

tlrmchlsmth committed 1 year ago

Verified 73aa6cfd

[Kernel] add triton fused moe kernel for gptq/awq (#12185)

jinzhen-lin committed 1 year ago

Verified 27b78c73

[Hardware][NV] Fix Modelopt model loading for k-v-scales for Llama models. (#11787)

pavanimajety committed 1 year ago

Verified b02fd288

[Frontend] Support override generation config in args (#12409)

liuyanyi committed 1 year ago

Verified ff7424f4

[Model] Refactoring of MiniCPM-V and add MiniCPM-o-2.6 support for vLLM (#12069)

HwwwwwwwH committed 1 year ago

Verified d93bf4da

[Bugfix] handle alignment of arguments in convert_sparse_cross_attention_mask_to_dense (#12347)

tjohnson31415 committed 1 year ago

Verified 036ca94c

Fix the pydantic logging validator (#12420)

maxdebayser committed 1 year ago

Verified ef001d98

[V1] Improve Error Message for Unsupported Config (#12535)

robertgshaw2-redhat committed 1 year ago

Verified 5f671cb4

Bugfix for whisper quantization due to fake k_proj bias (#12524)

mgoin committed 1 year ago

Verified bd02164c

[V1][Metrics] Add TTFT and TPOT histograms (#12530)

markmc committed 1 year ago

Verified 46fb0567

[Doc] Convert docs to use colon fences (#12471)

hmellor committed 1 year ago

Verified dd6a3a02

[Frontend] Support reasoning content for deepseek r1 (#12473)

gaocegege committed 1 year ago

Verified a7e3eba6

[TPU] Add example for profiling TPU inference (#12531)

mgoin committed 1 year ago

Verified fbb5bd4c

[Kernel] Pipe attn_logits_soft_cap through paged attention TPU kernels (#12482)

fenghuizhang committed 1 year ago

Verified 80fcc3ed

[V1][Metrics] Add per-request prompt/generation_tokens histograms (#12516)

markmc committed 1 year ago

Verified c386c43c

Do not run `suggestion` `pre-commit` hook multiple times (#12521)

hmellor committed 1 year ago

Verified f26d7907

Replace missed warning_once for rerank API (#12472)

mgoin committed 1 year ago

Verified 0f657bdc

[V1][Metrics] Hook up IterationStats for Prometheus metrics (#12478)

markmc committed 1 year ago

Verified 3fd1fb63

[Doc] Fix typo for x86 CPU installation (#12514)

waltforme committed 1 year ago

Verified 925d2f19

[VLM] Merged multi-modal processor and V1 support for Qwen-VL (#12504)

DarkLight1337 committed 1 year ago

Verified 8f58a513

[Core] Make raw_request optional in ServingCompletion (#12503)

schoennenbeck committed 1 year ago

Verified 2079e43b

[V1] Include Engine Version in Logs (#12496)

robertgshaw2-redhat committed 1 year ago

Verified e29d4358

Update README.md with V1 alpha release (#12495)

ywang96 committed 1 year ago

Verified 8cbc4249

[CI] fix pre-commit error (#12494)

MengqingCao committed 1 year ago

Verified dd66fd2b

Older