vllm-project/vllm

Pull Requests Commits

fix missing removal

zhuohan123 committed 1 year ago

a2599dca

[Misc] Remove unused virtual engine flag

zhuohan123 committed 1 year ago

3fd66b1e

[Kernel] Lazy import FlashInfer (#26977)

jeejeelee committed 1 year ago

Verified fec2b341

[Bugfix] Fix ReplicatedLinearWithLoRA (#27065)

jeejeelee committed 1 year ago

Verified 87bc0c49

[Core] Change `execute_model_with_error_logging()` to be a ctx manager (#27060)

njhill committed 1 year ago

Verified fe3b9372

[Bugfix][Qwen] fixes the weights dtype in qwen3_next: it is actually a bfloat16 (#27030)

sighingnow committed 1 year ago

Verified bde9e227

disable graph partition in custom op (#26952)

BoyuanFeng committed 1 year ago

Verified 08405609

[Perf] Exploit out-of-band buffers in shm_broadcast (#26961)

njhill committed 1 year ago

Verified ab81379e

[Docs] Reduce custom syntax used in docs (#27009)

hmellor committed 1 year ago

Verified 4ffd6e89

vllm bench serve shows num of failed requests (#26478)

tomasruizt committed 1 year ago

Verified 965c5f49

Remove unused imports (#26972)

lgeiger committed 1 year ago

Verified 4d055ef4

[torch.compile] fix simple inductor graph partition test (#27050)

BoyuanFeng committed 1 year ago

Verified 17c540a9

[Chore] Separate out `vllm.utils.importlib` (#27022)

DarkLight1337 committed 1 year ago

Verified 4d4d6bad

[torch.compile] Passing only necessary compilation config to inductor pass config (#27041)

luccafong committed 1 year ago

Verified 11ae016b

[NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714)

jiahanc committed 1 year ago

Verified 41d30719

Refactor Transformers backend to use mixins (#26906)

hmellor committed 1 year ago

Verified fb5e10d3

[small][batch invariance] Rename the env and internal flags to simplify usage (#26855)

bwasti committed 1 year ago

Verified b2f78cba

[Bug] Add Assertion for `random-input-len` / `random-output-len` (#26834)

yewentao256 committed 1 year ago

Verified 23583ee2

[CI] Prune Quantization Tests and skip compilation (#27038)

mgoin committed 1 year ago

Verified 01c977e9

[Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to `get_mk_alignment_for_contiguous_layout` (#26935)

yewentao256 committed 1 year ago

Verified b3dda72c

[GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997)

varun-sundar-rabindranath committed 1 year ago

Verified fb0571b0

[Bug] Fix batch invariant test `has` to `is` (#27032)

yewentao256 committed 1 year ago

Verified 2ed8b6b3

Adding Warmup to Benchmark Serving (#26943)

kimbochen committed 1 year ago

Verified 013abde6

[Compressed Tensors] Always clone output for compile robustness (#26849)

kylesayrs committed 1 year ago

Verified a5464dcf

Support block size of 256 used by Intel HPU (#26883)

mandy-li committed 1 year ago

Verified ac3ed5a8

[gpt-oss][1/N] EZ: refactor serving_responses for modularity (#26948)

qandrew committed 1 year ago

Verified e6ba2000

Support `set` in the CLI generation (#27031)

hmellor committed 1 year ago

Verified aa255ff5

Fix Qwen2.5 VL image grid docstring (#27033)

skyloevil committed 1 year ago

Verified 7bb736d0

[Model] Fix Qwen3VL mm mapping (#27027)

jeejeelee committed 1 year ago

Verified 9f4e3090

[Feature] Add process_weights_after_loading to AttentionImpl (#26870)

lengrongfu committed 1 year ago

Verified 5afd3276

Older