vllm-project/vllm

Pull Requests Commits

robertgshaw2-redhat committed 47 days ago

6de0982d

robertgshaw2-redhat committed 48 days ago

45fa7f9b

[Misc] Improve error message for incorrect pynvml (#12809)

youkaichao committed 106 days ago

Verified 0408efc6

[Misc] Remove duplicated DeepSeek V2/V3 model definition (#12793)

mgoin committed 106 days ago

Verified 449d1bce

Improve `TransformersModel` UX (#12785)

hmellor committed 106 days ago

Verified 1a6fcad4

[Bugfix] Fix the test_ultravox.py's license (#12806)

houseroad committed 106 days ago

Verified 56534cd5

[Model] LoRA Support for Ultravox model (#11253)

thedebugger committed 106 days ago

Verified d88506dd

[Misc][Easy] Remove the space from the file name

houseroad committed 106 days ago

Verified 9cdea30b

[Bugfix] Better FP8 supported defaults

LucasWilkinson committed 106 days ago

Verified 76abd0c8

[ROCm][Kernel] Using the correct warp_size value

gshtras committed 106 days ago

Verified 5b19b930

[VLM] Update compatibility with transformers 4.49

DarkLight1337 committed 106 days ago

Verified 75404d04

[VLM] Qwen2.5-VL

ywang96 committed 106 days ago

Verified bf3b79ef

[Docs] Drop duplicate [source] links

russellb committed 106 days ago

Verified 9a5b1554

[VLM] Use shared field to pass token ids to model

DarkLight1337 committed 106 days ago

Verified a4ce74c1

Add: Support for Sparse24Bitmask Compressed Models

rahul-tuli committed 106 days ago

Verified 3b2005e1

[Hardware][Intel-Gaudi] Enable FusedSDPA support for Intel Gaudi (HPU)

scsudhak-intel committed 106 days ago

Verified af8486de

Merging PR #12536

heheda12345 committed 106 days ago

Verified 4c3aac51

[core][distributed] exact ray placement control (#12732)

youkaichao committed 106 days ago

Verified bc1bdece

[Bugfix] Fix 'ModuleNotFoundError: No module named 'intel_extension_for_pytorch'' for --tensor-parallel-size more than 1 (#12546)

Akashcodes732 committed 107 days ago

Verified 022bcc70

[Doc] Remove performance warning for auto_awq.md (#12743)

mgoin committed 107 days ago

Verified c53dc466

[V1][Misc] Shorten `FinishReason` enum and use constant strings (#12760)

njhill committed 107 days ago

Verified 3d09e592

[Bugfix] Fix OpenVINO model runner (#12750)

hmellor committed 107 days ago

Verified fcf2e3d7

[Doc] Update PR Reminder with link to Developer Slack (#12748)

mgoin committed 107 days ago

Verified 58b218d7

[Model][Quant] Fix GLM, Fix fused module mappings for quantization (#12634)

kylesayrs committed 107 days ago

Verified 7ff7a638

[Misc] Bump the compressed-tensors version (#12736)

dsikka committed 107 days ago

Verified 686006a2

[VLM] Add MLA with pure RoPE support for deepseek-vl2 models (#12729)

Isotr0py committed 107 days ago

Verified 98fd089f

Refactor `Linear` handling in `TransformersModel` (#12727)

hmellor committed 107 days ago

Verified 249824c3

[ROCM][AMD][TRITON] Halving warps number for fw_prefill to reduce spilling (#12713)

maleksan85 committed 107 days ago

Verified 64862d10

[Core] add and implement `VLLM_LOGITS_PROCESSOR_THREADS` (#12368)

akeshet committed 107 days ago

Verified b3a0d01e

[Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676)

LucasWilkinson committed 107 days ago

Verified 75e94309

Older