vllm-project/vllm

Pull Requests Commits

tlrmchlsmth committed 28 days ago

cbd94b20

move stuff around

tlrmchlsmth committed 28 days ago

007219cf

Use fused silu-mul-quant with BatchedTritonExperts

tlrmchlsmth committed 28 days ago

fd977156

[Misc] Remove pad_for_cudagraphs from config (#30143)

LucasWilkinson committed 28 days ago

Verified 22613408

[Bugfix] Fix byte fallback handling when using outlines (#31391)

Alnusjaponica committed 28 days ago

Verified 86c69dc5

[AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205)

dolpm committed 28 days ago

Verified 7c5dedc2

[5/N] Initialize MM components in context managers (Q-Z) (#32695)

DarkLight1337 committed 28 days ago

Verified 193069d1

Test: added acceptance length tests (#32030)

rahul-tuli committed 28 days ago

Verified f0feb1cf

[Doc] Update docs for MM model development with context usage (#32691)

DarkLight1337 committed 28 days ago

Verified 09194b90

[Model Runner V2] Support FLASHINFER_MLA backend (#32709)

WoosukKwon committed 28 days ago

Verified 9ab4388c

[Bugfix] fix the ima issue of qwen-vit (#32687)

JJJYmmm committed 28 days ago

Verified 04a9e064

[Doc] [ROCm] Update ROCm getting started doc (#32580)

tjtanaa committed 28 days ago

Verified c025263d

[Perf] Only clone when needed for `moe_permute` (#32273)

yewentao256 committed 28 days ago

Verified 6c97b9b9

[PluggableLayer][1/N] Define PluggableLayer (#32331)

whx-sjtu committed 28 days ago

Verified 4ca62a0d

[Bugfix] Fix Off-by-one error in _num_tokens_to_min_blocks calculation (#32603)

lingebeng committed 28 days ago

Verified 7901109e

[XPU]Support AgRsAll2AllManager on XPU device (#32654)

ys950902 committed 28 days ago

Verified 13f6630a

[4/N] Initialize MM components in context managers (M-P) (#32663)

DarkLight1337 committed 28 days ago

Verified fda3f03e

[Metrics] Complete removal of deprecated vllm:time_per_output_token_seconds metric (#32661)

carlory committed 29 days ago

Verified bb917203

[Bugfix] Fix the fp8_mqa_logits dim mismatch (#32652)

chaunceyjiang committed 29 days ago

Verified c4e5bdf6

[3/N] Initialize MM components in context managers (I-L) (#32650)

DarkLight1337 committed 29 days ago

Verified 7f1bcd18

[Core] Cleanup shm based object store on engine shutdown (#32429)

walterbm committed 29 days ago

Verified 8be263c3

[2/N] Initialize MM components in context managers (E-H) (#32641)

DarkLight1337 committed 29 days ago

Verified e1a34c3a

[Refactor] Make FP8 Linear Ops use kernel abstraction (#27814)

vllmellm committed 29 days ago

Verified 148117ea

[Model Runner V2] Skip kernel launch for penalties & logit_bias (#32634)

WoosukKwon committed 29 days ago

Verified e9c83cdc

[1/N] Initialize MM components in context managers (A-D) (#32632)

DarkLight1337 committed 29 days ago

Verified b75e85de

[Model] Use context managers for encoder- and LM-only mode (#32605)

DarkLight1337 committed 29 days ago

Verified 4753f3bf

[Model Runner V2] Decouple temperature from penalties (#32629)

WoosukKwon committed 29 days ago

Verified 6c01ffb8

[Model Runner V2] Refactor get_cudagraph_and_dp_padding (#32625)

WoosukKwon committed 29 days ago

Verified 7b7cdce9

[Feat] allow inplace loading lora (#31326)

Jackmin801 committed 29 days ago

Verified 12dab78f

[Model Runner V2] Initialized communication buffer for DP (#32624)

WoosukKwon committed 29 days ago

Verified 05dc4bfa

Older