vllm-project/vllm

Pull Requests Commits

WoosukKwon committed 37 days ago

f3550b84

WoosukKwon committed 37 days ago

980c14db

revert bf16 fusion

WoosukKwon committed 37 days ago

87c5064d

Merge branch 'main' into woosuk/ds-exp-2

WoosukKwon committed 37 days ago

c9a6864e

Revert "metadata opt"

WoosukKwon committed 37 days ago

67cecb7b

WoosukKwon committed 37 days ago

ba89779e

WoosukKwon committed 37 days ago

5241e021

WoosukKwon committed 38 days ago

e80639be

[UX] Defer some imports on CLI paths to save ~2s (#40056)

mgoin committed 38 days ago

Verified 1948d0c4

Add fusion back

WoosukKwon committed 38 days ago

b6d5fd6a

[CI/Build] Apply ruff formatter to pass pre-commit (#40078)

Alnusjaponica committed 38 days ago

Verified 4c47710b

[MLA] Optimize mla indexer prepare uniform decode for MTP > 1 (#39458)

TheEpicDolphin committed 38 days ago

Verified bf9a5ddb

[Bugfix] Temporarily disable B200 fp4 MoE layer tests (#40057)

bnellnm committed 38 days ago

Verified 79e799eb

Bugfix: Parakeet: `.conv.pointwise/depthwise_conv1/2.bias weigths` can exist even if `convolution_bias=False` (#40007)

netanel-haber committed 38 days ago

Verified c4e601c7

[Compilation] Add Unit Tests for VllmFusionPatternMatcherPass (#39692)

BadrBasowid committed 38 days ago

Verified 29057d3b

[Misc] Update `committers.md` (#40058)

MatthewBonanni committed 38 days ago

Verified 219bb5b8

[Quantization] Consolidate experts_int8 with fp8 online quantization (#38463)

Josephasafg committed 38 days ago

Verified ad2b1277

Gate SSU dispatch setup (#40039)

roikoren755 committed 38 days ago

Verified b897f00c

[CI] Add weight transfer tests to CI (#39821)

SumanthRH committed 38 days ago

Verified adf9bb3c

[Misc] Add @sfeng33 to CODEOWNERS (#40048)

sfeng33 committed 38 days ago

Verified b16fda62

[Bugfix] Fix bench_serve UTF-8 decode crash on split multi-byte chars (#38732)

he-yufeng committed 38 days ago

Verified de111f32

[bugfix] Normalize tool message content from array to string format (#39899)

JaredforReal committed 38 days ago

Verified afabb5f4

[Bugfix] Fix audioflamingo test (#40052)

ywang96 committed 38 days ago

Verified 3abb7560

[Misc] Move `pyav` and `soundfile` to common requirements (#39997)

Isotr0py committed 38 days ago

Verified 617d1c2f

[Bugfix] Fix Ray compiled-DAG SHM channel stalls by detaching zero-copy `np.ndarray` logprobs buffers (#35736)

JeanPaulShapo committed 38 days ago

Verified 692db29c

[Refactor] Remove `resampy` dependency (#39524)

Isotr0py committed 38 days ago

Verified 82531edb

[Misc] `toy_proxy_server` handle min_tokens (#39706)

NickLucche committed 38 days ago

Verified 3daca38e

[Bugfix] Fix LLM priority normalization for single-string prompts (#40011)

daiyu1111 committed 38 days ago

Verified a302a8fd

[Frontend][last/5] Improve pooling entrypoints | clean up. (#39675)

noooop committed 38 days ago

Verified 4e8c3f1c

[Doc] add docs for online quant frontend (#39736)

vkuzo committed 38 days ago

Verified 5e5afafa

Older