vllm-project/vllm

Pull Requests Commits

Do not run `suggestion` `pre-commit` hook multiple times (#12521)

hmellor committed 323 days ago

Verified f26d7907

Replace missed warning_once for rerank API (#12472)

mgoin committed 323 days ago

Verified 0f657bdc

[V1][Metrics] Hook up IterationStats for Prometheus metrics (#12478)

markmc committed 323 days ago

Verified 3fd1fb63

[Doc] Fix typo for x86 CPU installation (#12514)

waltforme committed 323 days ago

Verified 925d2f19

[VLM] Merged multi-modal processor and V1 support for Qwen-VL (#12504)

DarkLight1337 committed 323 days ago

Verified 8f58a513

[Core] Make raw_request optional in ServingCompletion (#12503)

schoennenbeck committed 324 days ago

Verified 2079e43b

[V1] Include Engine Version in Logs (#12496)

robertgshaw2-redhat committed 324 days ago

Verified e29d4358

Update README.md with V1 alpha release (#12495)

ywang96 committed 324 days ago

Verified 8cbc4249

[CI] fix pre-commit error (#12494)

MengqingCao committed 324 days ago

Verified dd66fd2b

[FEATURE] Enables offline /score for embedding models (#12021)

gmarinho2 committed 324 days ago

Verified 0f465ab5

[CI/Build] Fixed the xla nightly issue report in #12451 (#12453)

hosseinsarshar committed 324 days ago

Verified 23a7cbc8

Fix bad path in prometheus example (#12481)

mgoin committed 324 days ago

Verified 426a5c36

[Neuron][Kernel] NKI-based flash-attention kernel with paged KV cache (#11277)

liangfu committed 324 days ago

Verified ddee88d0

Update `pre-commit` hooks (#12475)

hmellor committed 324 days ago

Verified 823ab796

[Feature] [Spec decode]: Enable MLPSpeculator/Medusa and `prompt_logprobs` with ChunkedPrefill (#10132)

NickLucche committed 324 days ago

Verified 6116ca8c

[FlashInfer] Upgrade to 0.2.0 (#11194)

abmfy committed 324 days ago

Verified 2bc3fbba

[V1][CI/Test] Do basic test for top-p & top-k sampling (#12469)

WoosukKwon committed 324 days ago

Verified 3f1fc742

[V1][Metrics] Add initial Prometheus logger (#12416)

markmc committed 324 days ago

Verified 01ba9270

[Build] Only build 9.0a for scaled_mm and sparse kernels (#12339)

LucasWilkinson committed 324 days ago

Verified 103bd17a

[Bugfix] Fix gpt2 GGUF inference (#12467)

Isotr0py committed 325 days ago

Verified ce69f7f7

[V1][Minor] Minor optimizations for update_from_output (#12454)

WoosukKwon committed 325 days ago

Verified 624a1e47

[Bugfix] Fix missing seq_start_loc in xformers prefill metadata (#12464)

Isotr0py committed 325 days ago

Verified 372bf089

[Bugfix] Fix Granite 3.0 MoE model loading (#12446)

DarkLight1337 committed 325 days ago

Verified 5204ff5c

[Frontend] Support scores endpoint in run_batch (#12430)

pooyadavoodi committed 325 days ago

Verified 0cc6b383

[V1] Avoid list creation in input preparation (#12457)

WoosukKwon committed 325 days ago

Verified 28e07508

[DOC] Add link to vLLM blog (#12460)

terrytangyuan committed 325 days ago

Verified 582cf787

[Frontend] Rerank API (Jina- and Cohere-compatible API) (#12376)

K-Mistele committed 325 days ago

Verified 0034b09c

[Build/CI] Fix libcuda.so linkage (#12424)

tlrmchlsmth committed 325 days ago

Verified 72bac730

[Bugfix][Kernel] Fix perf regression caused by PR #12405 (#12434)

LucasWilkinson committed 325 days ago

Verified 68f11149

[Bugfix/CI] Fix broken kernels/test_mha.py (#12450)

tlrmchlsmth committed 325 days ago

Verified 72f48804

Newer Older