vllm-project/vllm

Pull Requests Commits

[Bug] DeepGemm: Fix Cuda Init Error (#21312)

yewentao256 committed 163 days ago

Verified e69a92a1

[Misc] DeepEPHighThroughtput - Enable Inductor pass (#21311)

varun-sundar-rabindranath committed 163 days ago

Verified 8425f785

Fix kv_cache_dtype handling for out-of-tree HPU plugin (#21302)

kzawora-intel committed 163 days ago

Verified c17231e8

[Refactor] Fix Compile Warning #1444-D (#21208)

yewentao256 committed 163 days ago

Verified 6e5b5ca5

[V1] [Hybrid] Add new test to verify that hybrid views into KVCacheTensor are compatible (#21300)

tdoublep committed 163 days ago

Verified 488d8a98

[Core] Minimize number of dict lookup in _maybe_evict_cached_block (#21281)

Jialin committed 163 days ago

Verified af376ca1

Revert "[Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) (#21334)

minosfuture committed 163 days ago

Verified e7b20426

[Intel GPU] Ray Compiled Graph avoid NCCL for Intel GPU (#21338)

ratnampa committed 163 days ago

Verified 90f1e554

[Doc] Fix CPU doc format (#21316)

bigPYJ1151 committed 163 days ago

Verified 5e70dcd6

[XPU] Enable external_launcher to serve as an executor via torchrun (#21021)

chaojun-zhang committed 163 days ago

Verified 25d585ab

[v1][sampler] Inplace logprobs comparison to get the token rank (#21283)

houseroad committed 163 days ago

Verified 8d0a01a5

Merge remote-tracking branch 'origin/main' into one-pod-per-node-lb

njhill committed 163 days ago

60ae2239

[perf] Speed up align sum kernels (#21079)

hj-mistral committed 163 days ago

Verified 0ec82edd

Fix bad lm-eval fork (#21318)

mgoin committed 163 days ago

Verified 005ae9be

[DP] Fix Prometheus Logging (#21257)

robertgshaw2-redhat committed 164 days ago

Verified 29d1ffc5

[Attention] Clean up iRoPE in V1 (#21188)

LucasWilkinson committed 164 days ago

Verified 304dce7e

[Misc] Add dummy maverick test (#21199)

minosfuture committed 164 days ago

Verified 6ece16c4

[BugFix] make utils.current_stream thread-safety (#21252) (#21253)

simpx committed 164 days ago

Verified a0e827e0

[CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289)

bigPYJ1151 committed 164 days ago

Verified a15a50fc

[Misc] Add sliding window to flashinfer test (#21282)

WoosukKwon committed 164 days ago

Verified 6dda13c8

fix data_parallel_hybrid_lb arg default value

njhill committed 164 days ago

7a793ad5

Add Nvidia ModelOpt config adaptation (#19815)

Edwardf0t1 committed 164 days ago

Verified 6b46c4b6

Update vllm/engine/arg_utils.py

robertgshaw2-redhat committed 164 days ago

Verified 58e4227f

[Misc] unify variable for LLM instance (#20996)

andyxning committed 164 days ago

Verified d9784107

[Docs] Make tables more space efficient in `supported_models.md` (#21291)

hmellor committed 164 days ago

Verified e6b90a28

[Docs] Fix hardcoded links in docs (#21287)

hmellor committed 164 days ago

Verified be54a951

[Model][1/N] Support multiple poolers at model level (#21227)

DarkLight1337 committed 164 days ago

Verified 042af0c8

[Bugfix] Fix missing placeholder in logger debug (#21280)

DarkLight1337 committed 164 days ago

Verified 378d33c3

Add the instruction to run e2e validation manually before release (#21023)

huydhn committed 164 days ago

Verified 940af1f0

[Docs] Add RFC Meeting to Issue Template (#21279)

simon-mo committed 164 days ago

Verified 92615d7f

Newer Older