vllm-project/vllm

Pull Requests Commits

djmmoss committed 55 days ago

7ddf8622

djmmoss committed 55 days ago

4e97071d

tp and ep support

djmmoss committed 55 days ago

f37a31d9

finished integration

djmmoss committed 55 days ago

ee45599e

[Multimodal] Make MediaConnector extensible. (#27759)

huachenheli committed 55 days ago

Verified 1fb4217a

Added disable rule to track files under benchmarks/lib (#28048)

nadavkluger committed 55 days ago

Verified 611c86ea

[ROCm][Perf] New design on ROCm AITER MHA backend Implementation (#25763)

ganyi1996ppo committed 55 days ago

Verified dc937175

Remove deprecated `--rope-scaling` and `--rope-theta` (#28006)

hmellor committed 55 days ago

Verified 2f1cc8ce

[AsyncScheduling] Don't schedule past request max_tokens (#27922)

njhill committed 55 days ago

Verified 938a8169

[PerfFix] Avoid separate thread for MP executor shm spin (#28012)

njhill committed 55 days ago

Verified c9f66da8

[model] Add support for openPangu_Ultra_MoE (#27521)

yt0428 committed 55 days ago

Verified 05cae69f

[PERF] Decouple projections from GDN custom op (#27512)

vadiklyutiy committed 55 days ago

Verified 5fd8f02e

[Perf] SM100 - add swap AB optimization to CUTLASS FP8 GEMM (#27284)

LyrisZhong committed 55 days ago

Verified 97e3dda8

[BugFix] Fix incorrect preallocated sampled_token_ids tensor size (#28025)

njhill committed 55 days ago

Verified 5a0a6dfd

[Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123)

bnellnm committed 55 days ago

Verified 938772af

[Model] add optimal triton fused moe configs for NemotronH MoE (#27967)

tomeras91 committed 56 days ago

Verified e4ee6586

[Model][Bugfix] fix pipeline parallelism support for NemotronH (#27968)

tomeras91 committed 56 days ago

Verified 77f8001f

[Core] Enable StatLogger in LLMEngine (#28020)

zhuohan123 committed 56 days ago

Verified 300a2659

Support using Int4PreshuffledTensor after loading (#26066)

jerryzh168 committed 56 days ago

Verified 03c4c4aa

Load tuned fused_moe_lora shrink and expand kernel configs separately (#27435)

yugong333 committed 56 days ago

Verified 2ec401bc

[BugFix][Performance] Restore flashinfer autotuning for all scenarios (#27904)

varun-sundar-rabindranath committed 56 days ago

Verified 4022a9d2

[CI/Build] Fix OpenAI API correctness on AMD CI (#28022)

zhewenl committed 56 days ago

Verified 53f6e81d

[Model] fix ernie45 reasoning_parser (#27973)

CSWYF3634076 committed 56 days ago

Verified 43a6acfb

[KV Connector] Make KVCacheConfig an explicit constructor argument (#27887)

markmc committed 56 days ago

Verified 58279c60

[CI/Build] Update LM Eval Version in AMD CI (#27944)

zhewenl committed 56 days ago

Verified 2f84ae1f

[CPU]Improve dynamic 4bit moe performance (#27240)

xiangze-arm committed 56 days ago

Verified f32cbc9a

[Bug] Batch invariant: Fix flash attn MLA `RuntimeError: scheduler_metadata must have shape (metadata_size)` (#27884)

yewentao256 committed 56 days ago

Verified 7e4be741

[Metrics] Enable sleep state metric outside of dev mode (#27867)

markmc committed 56 days ago

Verified 380ba681

[NIXL][XPU] Pin NIXL version to 0.7.0 (#27849)

zhenwei-intel committed 56 days ago

Verified 14a125a0

[Refactor] Lazy import tool_parser (#27974)

chaunceyjiang committed 56 days ago

Verified c02fccdb

Older