vllm-project/vllm

Pull Requests Commits

[Core][Distributed] improve p2p access check (#4992)

youkaichao committed 1 year ago

Verified 594392d2

[Bugfix] Fix arguments passed to `Sequence` in stop checker test (#5092)

DarkLight1337 committed 1 year ago

Verified 18c1f16d

[Core][Optimization] remove vllm-nccl (#5091)

youkaichao committed 1 year ago

Verified 5bd3c650

[Misc] add gpu_memory_utilization arg (#5079)

pandyamarut committed 1 year ago

Verified 616e600e

[Bugfix] Remove the last EOS token unless explicitly specified (#5077)

jsato8094 committed 1 year ago

Verified dfba529b

[Core] Consolidate prompt arguments to LLM engines (#4328)

DarkLight1337 committed 1 year ago

Verified 5ae5ed1e

[Docs] Add Dropbox as sponsors (#5089)

simon-mo committed 1 year ago

Verified 290f4ada

[Kernel][ROCm][AMD] Add fused_moe Triton configs for MI300X (#4951)

divakar-amd committed 1 year ago

Verified dd8de11f

[BugFix] Fix Embedding Models with TP>1 (#5075)

robertgshaw2-redhat committed 1 year ago

Verified 9ba41558

[Core] Sliding window for block manager v2 (#4545)

mmoskal committed 1 year ago

Verified d4f39859

[Model] Add support for falcon-11B (#5069)

Isotr0py committed 1 year ago

Verified 890aa93d

[Core] Allow AQLM on Pascal (#5058)

sasha0552 committed 1 year ago

Verified fbdb7b3e

[Bugfix / Core] Prefix Caching Guards (merged with main) (#4846)

zhuohan123 committed 1 year ago

Verified 1102bef2

[Misc] Make Serving Benchmark More User-friendly (#5044)

ywang96 committed 1 year ago

Verified f17a1a8f

[Dynamic Spec Decoding] Minor fix for disabling speculative decoding (#5000)

LiuXiaoxuanPKU committed 1 year ago

Verified d5a16977

[Misc] add logging level env var (#5045)

youkaichao committed 1 year ago

Verified 325c1199

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799)

linxihui committed 1 year ago

Verified 8e192ff9

[Core][Bugfix]: fix prefix caching for blockv2 (#4764)

leiwen83 committed 1 year ago

Verified e64fde4b

[Bugfix] Fix Mistral v0.3 Weight Loading (#5005)

robertgshaw2-redhat committed 1 year ago

Verified 91977095

[Doc] add ccache guide in doc (#5012)

youkaichao committed 1 year ago

Verified 6a50f4ca

[Core]: Option To Use Prompt Token Ids Inside Logits Processor (#4985)

kezouke committed 1 year ago

Verified e3470f87

[Kernel] Initial Activation Quantization Support (#4525)

dsikka committed 1 year ago

Verified a1242324

[Core][1/N] Support send/recv in PyNCCL Groups (#4988)

andoorve committed 1 year ago

Verified 5eda2ea0

[Bugfix] Update Dockerfile.cpu to fix NameError: name 'vllm_ops' is not defined (#5009)

LetianLee committed 1 year ago

Verified 2ba80bed

Marlin 24 prefill performance improvement (about 25% better on average) (#4983)

alexm-redhat committed 1 year ago

Verified 60662532

[Misc] Take user preference in attention selector (#4960)

comaniac committed 1 year ago

Verified ee3eea0a

[Minor] Fix small typo in llama.py: QKVParallelLinear -> QuantizationConfig (#4991)

pcmoritz committed 1 year ago

Verified a36de682

[Core] Eliminate parallel worker per-step task scheduling overhead (#4894)

njhill committed 1 year ago

Verified eb6d3c26

[Model] LoRA gptbigcode implementation (#3949)

raywanb committed 1 year ago

Verified 97b03000

[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)

comaniac committed 1 year ago

Verified a3a73ab0

Newer Older