vllm-project/vllm

Pull Requests Commits

Move `StructuredOutputsConfig` from `config/__init__.py` to `config/structured_outputs.py` (#25153)

hmellor committed 1 year ago

Verified 8ed039d5

[Model] Improve Pooling Model (#25149)

jeejeelee committed 1 year ago

Verified 37970105

[Frontend] Support setting logprobs to -1 (#25031)

chaunceyjiang committed 1 year ago

Verified cc935fdd

silu-v1: Fix EPS not being used during max-reduction (#25069)

elvircrn committed 1 year ago

Verified abdfcd4f

Fix: Add explicit #include <omp.h> for OpenMP compatibility on certain toolchains (#24951)

ihb2032 committed 1 year ago

Verified 4f02b77d

[Chore] Cleanup guided namespace, move to structured outputs config (#22772)

aarnphm committed 1 year ago

Verified 29283e89

[Doc] Fix cross-reference warnings (#25058)

punitvara committed 1 year ago

Verified 05b044e6

Add 'path' option to ImagePrompt data_format (#25081)

gfinol committed 1 year ago

Verified aa3f105c

[Qwen] Add fp8 checkpoint support for qwen3-next. (#25079)

sighingnow committed 1 year ago

Verified ef7eefe1

[Bugfix] when use s3 model cannot use default load_format (#24435)

lengrongfu committed 1 year ago

Verified 350c94de

Retrieve `sliding_window` from text config in Gemma3 MM (#25085)

hmellor committed 1 year ago

Verified f4cd80f9

[Docs] Fix API Reference (#25140)

hmellor committed 1 year ago

Verified 349e0e34

[Kernel] Better inf handling for grouped topk cu (#24886)

lumina37 committed 1 year ago

Verified 81b16a2b

[CLI] Use streaming in CLI chat and completion commands (#23769)

simon-mo committed 1 year ago

Verified e111d5b0

[benchmark] add peak throughput metrics and plot (#23867)

simon-mo committed 1 year ago

Verified a904ea78

[Spec Decode] Efficient padded speculation (#24539)

benchislett committed 1 year ago

Verified b7433ca1

[V0 Deprecation] Remove more V0 tests (#25117)

WoosukKwon committed 1 year ago

Verified 5c65a72b

[EPLB] Add EPLB support for hunyuan_v1 (#23078)

666even666 committed 1 year ago

Verified 9d8a2d86

[XPU] Whisper model support on XPU Platform (#25123)

chaojun-zhang committed 1 year ago

Verified 3bc18127

Mark prompt logprobs as incompatible with prompt embeds at API level (#25077)

qthequartermasterman committed 1 year ago

Verified bec060fd

[Model] enable data parallel for InternVL vision encoder (#23909)

666even666 committed 1 year ago

Verified 52bc9d5b

[Kernels] Overlap shared experts with combine instead of dispatch (#24254)

bnellnm committed 1 year ago

Verified dc2979c5

[Bugfix][Qwen3-Next] add prefixes to shared_expert in qwen3-next and mlp in qwen2moe to successfully load ignored params in quantized models (#24960)

toncao committed 1 year ago

Verified 027d37df

[Core][MM] Cleanup `MultiModalCache` (#25006)

lgeiger committed 1 year ago

Verified b9821967

[Docs] Clean up the contributing README (#25099)

hmellor committed 1 year ago

Verified 32baf1d0

[MM Encoder] Apply DP ViT for Qwen3-VL model series (#24955)

ywang96 committed 1 year ago

Verified 3127274d

[Kernels] Enable DeepGEMM by default (#24462)

bnellnm committed 1 year ago

Verified 4ac510f4

[V0 Deprecation] Skip PP test (#25128)

WoosukKwon committed 1 year ago

Verified 7fb2a5be

[V0 Deprecation] Remove misc V0 tests (#25118)

WoosukKwon committed 1 year ago

Verified 6c036615

[V0 Deprecation] Remove V0 Tracing & Metrics tests (#25115)

WoosukKwon committed 1 year ago

Verified 2fc24e94

Newer Older