vllm-project/vllm

Pull Requests Commits

[Misc] add chatbox integration (#17828)

reidliu41 committed 345 days ago

Verified 53d0cb74

[Easy] Eliminate c10::optional usage in vllm/csrc (#17819)

houseroad committed 345 days ago

Verified f50dcb7c

[Doc] Fix a typo in the file name (#17836)

DarkLight1337 committed 345 days ago

Verified a1e19b63

[Bugfix] Fix quark fp8 format loading on AMD GPUs (#12612)

fxmarty-amd committed 345 days ago

Verified bb239a73

[TPU] Fix the test_sampler (#17820)

bythew3i committed 345 days ago

Verified a463555d

[Bugfix] Fix tool call template validation for Mistral models (#17644)

RIckYuan999 committed 345 days ago

Verified ca04b97c

[Misc] support model prefix & add deepseek vl2 tiny fused moe config (#17763)

xsank committed 345 days ago

Verified 0a9bbaa1

[Bugfix] Fix bad words for Mistral models (#17753)

qionghuang6 committed 345 days ago

Verified 39956efb

[Qwen3]add qwen3-235b-bf16 fused moe config on A100 (#17715)

Ximingwang-09 committed 345 days ago

Verified 597051e5

[Frontend] Chat template fallbacks for multimodal models (#17805)

DarkLight1337 committed 345 days ago

Verified 96722aa8

[Hardware][Intel-Gaudi] Support Automatic Prefix Caching on HPU (#17648)

adobrzyn committed 345 days ago

Verified 843b2227

[Hardware][Power] Enable compressed tensor W8A8 INT8 quantization for POWER (#17153)

Akashcodes732 committed 345 days ago

Verified e515668e

[Kernel][Hardware][AMD] Bf16 mfma opt for ROCm skinny GEMMs (#17071)

amd-hhashemi committed 345 days ago

Verified 5a499e70

[V1] Add VLLM_ALLOW_INSECURE_SERIALIZATION env var (#17490)

russellb committed 345 days ago

Verified 6930a411

Only log non-default CLI args for online serving (#17803)

hmellor committed 345 days ago

Verified 998eea4a

[Installation] OpenTelemetry version update (#17771)

Xarbirus committed 345 days ago

Verified c747d845

Improve exception reporting in MP engine (#17800)

vmarkovtsev committed 345 days ago

Verified b2da14a0

[Core] Support full cuda graph in v1 (#16072)

chanh committed 345 days ago

Verified 7ea2adb8

[BugFix] Fix `--disable-log-stats` in V1 server mode (#17600)

njhill committed 345 days ago

Verified 3d13ca0e

Don't call the venv `vllm` (#17810)

hmellor committed 345 days ago

Verified 66ab3b13

[Chore][Doc] uses model id determined from OpenAI client (#17815)

aarnphm committed 345 days ago

Verified a8238bbd

[Core][Feature] Input metadata dump on crash (#13407)

wallashss committed 345 days ago

Verified d43f914d

[BugFix] Avoid secondary missing `MultiprocExecutor.workers` error (#17811)

njhill committed 346 days ago

Verified ed5272cf

[Hardware][TPU][V1] Multi-LoRA implementation for the V1 TPU backend (#14238)

Akshat-Tripathi committed 346 days ago

Verified c20ef40f

[Quantization] Quark MXFP4 format loading (#16943)

BowenBao committed 346 days ago

Verified db593aa6

[Bugfix] Fix missing lora name mapping for lora without prefix (#17793)

Isotr0py committed 346 days ago

Verified f98e3075

Fix and simplify `deprecated=True` CLI `kwarg` (#17781)

hmellor committed 346 days ago

Verified 646a31e5

[Bugfix] Fix Video IO error for short video (#17791)

Isotr0py committed 346 days ago

Verified be8ff88e

Only depend on importlib-metadata for Python < 3.10 (#17776)

tiran committed 346 days ago

Verified 1a6af145

[ROCm][FP8][Kernel] FP8 quantization fused into Custom Paged Attention (#17139)

gshtras committed 346 days ago

Verified 32aa74c0

Newer Older