vllm-project/vllm

Pull Requests Commits

WoosukKwon committed 128 days ago

1aa5adb1

[Model] Add support for deepseek-vl2-tiny model (#12068)

Isotr0py committed 128 days ago

Verified 62b06ba2

[misc] Add LoRA kernel micro benchmarks (#11579)

varun-sundar-rabindranath committed 128 days ago

Verified 5fd24ec0

[Bugfix] Fix max image feature size for Llava-one-vision (#12104)

ywang96 committed 128 days ago

Verified 874f7c29

[core] LLM.collective_rpc interface and RLHF example (#12084)

youkaichao committed 128 days ago

Verified 92e793d9

Support torchrun and SPMD-style offline inference (#12071)

youkaichao committed 128 days ago

Verified bf53e0c7

[Bugfix] Remove hardcoded `head_size=256` for Deepseek v2 and v3 (#12067)

Isotr0py committed 129 days ago

Verified dd7c9ad8

Various cosmetic/comment fixes (#12089)

mgoin committed 129 days ago

Verified 9aa1519f

[Doc] Add documentation for specifying model architecture (#12105)

DarkLight1337 committed 129 days ago

Verified f8ef146f

[Core] Default to using per_token quantization for fp8 when cutlass is supported. (#8651)

elfiegg committed 129 days ago

Verified fa0050db

Allow hip sources to be directly included when compiling for rocm. (#12087)

tvirolai-amd committed 129 days ago

Verified cd9d06fb

[Bugfix] Fix _get_lora_device for HQQ marlin (#12090)

varun-sundar-rabindranath committed 129 days ago

Verified ebd8c669

[V1][Core] Autotune encoder cache budget (#11895)

ywang96 committed 129 days ago

Verified 70755e81

[Bugfix] use right truncation for non-generative tasks (#12050)

joerunde committed 129 days ago

Verified edce722e

[Doc]: Update `OpenAI-Compatible Server` documents (#12082)

maang-h committed 129 days ago

Verified 57e729e8

[Misc][Quark] Upstream Quark format to VLLM (#10765)

kewang-xlnx committed 129 days ago

Verified de0526f6

Misc: allow to use proxy in `HTTPConnection` (#12042)

zhouyuan committed 129 days ago

Verified 5ecf3e0a

[Model]: Support internlm3 (#12037)

RunningLeon committed 129 days ago

Verified 97eb97b5

[Platform] Do not raise error if _Backend is not found (#12023)

wangxiyuan committed 130 days ago

Verified 3adf0ffd

Type-fix: make execute_model output type optional (#12020)

youngkent committed 130 days ago

Verified ad388d25

Fix: cases with empty sparsity config (#12057)

rahul-tuli committed 130 days ago

Verified cbe94391

[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCacheManager (#12003)

heheda12345 committed 130 days ago

Verified 994fc655

[Doc] Update examples to remove SparseAutoModelForCausalLM (#12062)

kylesayrs committed 130 days ago

Verified 3f9b7ab9

[core] platform agnostic executor via collective_rpc (#11256)

youkaichao committed 130 days ago

Verified ad34c0df

[core] Turn off GPU communication overlap for Ray executor (#12051)

ruisearch42 committed 130 days ago

Verified f218f9c2

[Misc] Add multipstep chunked-prefill support for FlashInfer (#10467)

elfiegg committed 130 days ago

Verified 0794e744

[V1][BugFix] Fix edge case in VLM scheduling (#12065)

WoosukKwon committed 130 days ago

Verified b7ee940a

[Platform] move current_memory_usage() into platform (#11369)

shen-shanshan committed 130 days ago

Verified 9ddac563

[HPU][Bugfix] Don't use /dev/accel/accel0 for HPU autodetection in setup.py (#12046)

kzawora-intel committed 130 days ago

Verified 1a51b9f8

[Kernel] Support MulAndSilu (#11624)

jeejeelee committed 130 days ago

Verified 42f5e7c5

Older