vllm-project/vllm

Pull Requests Commits

[V1][Metrics] Add several request timing histograms (#12644)

markmc committed 302 days ago

Verified 75e6e145

[Bugfix] fix flaky test (#13089)

SmartManoj committed 302 days ago

Verified 110f59a3

[Platform] add pre_register_and_update function (#12432)

wangxiyuan committed 302 days ago

Verified 2e3b969e

[Build] Fix cuda link target of cumem_allocator in CPU env (#12863)

guoyuhong committed 302 days ago

Verified da317197

[ROCm] Using a more precise memory profiling (#12624)

gshtras committed 302 days ago

Verified 7539bbc6

[executor] init `local_rank` as device index (#13027)

MengqingCao committed 302 days ago

Verified 9cf47594

[V1][Metrics] Add GPU prefix cache hit rate % gauge (#12592)

comaniac committed 302 days ago

Verified 41c5dd45

[Bugfix]: Reasoning output bug according to the chat template change (#13025)

gaocegege committed 302 days ago

Verified fc6485d2

[Misc] LoRA - Refactor Punica ops tests (#12970)

varun-sundar-rabindranath committed 302 days ago

Verified 78a141d7

[Core] Don't do platform detection at import time (#12933)

russellb committed 302 days ago

Verified c320ca8e

[Benchmark] Add BurstGPT to benchmark_serving (#13063)

WoosukKwon committed 302 days ago

Verified 58047c6f

[Bugfix] Support missing tool parameters in mistral tokenizer (#12884)

fgreinacher committed 303 days ago

Verified cb080f32

[Docs] Annouce Meta Meetup (#13065)

simon-mo committed 303 days ago

Verified 2c0f5820

[V1][Minor] Move scheduler outputs to a separate file (#13062)

WoosukKwon committed 303 days ago

Verified 2ff48576

[misc] Fix setup.py condition to avoid AMD from being mistaken with CPU (#13022)

khluu committed 303 days ago

Verified 91e87675

[Model] Ultravox Model: Support v0.5 Release (#12912)

farzadab committed 303 days ago

Verified 08b2d845

Support AWQMarlin with MLA

mgoin committed 303 days ago

d56ef8b6

Fix seed parameter behavior in vLLM (#13007)

SmartManoj committed 303 days ago

Verified 2ae88905

[Bugfix] Clean up and fix multi-modal processors (#13012)

DarkLight1337 committed 303 days ago

Verified 51f0b5f7

[misc] Add retries with exponential backoff for HF file existence check (#13008)

khluu committed 303 days ago

Verified fde71262

[Doc] Add link to tool_choice tracking issue in tool_calling.md (#13003)

terrytangyuan committed 303 days ago

Verified 24313714

[core] fix sleep mode and pytorch checkpoint compatibility (#13001)

youkaichao committed 303 days ago

Verified b2496bb0

Check if selected backend is None in get_attn_backend_cls() (#12975)

terrytangyuan committed 304 days ago

Verified 44607e07

[V1] Use msgpack for core request serialization (#12918)

njhill committed 304 days ago

Verified 67c4637c

[core][rlhf] add colocate example for RLHF (#12984)

youkaichao committed 304 days ago

Verified aa0ca5eb

[core] improve error handling when wake up from sleep mode (#12981)

youkaichao committed 304 days ago

Verified 59fff4a0

[MISC] Always import version library first in the vllm package (#12979)

houseroad committed 304 days ago

Verified 29f1d47e

[core] port pynvml into vllm codebase (#12963)

youkaichao committed 304 days ago

Verified cf797aa8

[V1] Cache `uses_mrope` in GPUModelRunner (#12969)

WoosukKwon committed 305 days ago

Verified 24700c34

[RFC] [Mistral] FP8 format (#10130)

patrickvonplaten committed 305 days ago

Verified d366ccc4

Newer Older