vllm-project/vllm

Pull Requests Commits

[Docs] Remove API Reference from search index (#25949)

hmellor committed 1 year ago

Verified 2ce26b9b

Add explicit pooling classes for the Transformers backend (#25322)

hmellor committed 1 year ago

Verified a388252a

[V1] [P/D] Add Support for KV Load Failure Recovery (#19330)

sdavidbd committed 1 year ago

Verified 9a9f48df

[Bench] Add DeepSeekV32 to MoE benchmark (#25962)

jeejeelee committed 1 year ago

Verified 67f3fb08

[Llama4] [multimodal] Fix misplaced dtype cast of `cos_sin_cache` in `Llama4VisionRotaryEmbedding` (#25889)

cjackal committed 1 year ago

Verified 43b752c3

OffloadingConnector: Fix GPU block tracking bug (#25856)

orozery committed 1 year ago

Verified cfd302db

[Docs] Add moe kernel features doc (#25297)

bnellnm committed 1 year ago

Verified fb610ae6

[Doc] Improve MM Pooling model documentation (#25966)

DarkLight1337 committed 1 year ago

Verified 2f652e6c

[Bug] Fix AttributeError: 'QKVParallelLinear' object has no attribute 'orig_dtype' (#25958)

yewentao256 committed 1 year ago

Verified e6a226ef

[bugfix][deepseek] fix flashmla kernel selection (#25956)

youkaichao committed 1 year ago

Verified a2e6fa7e

[Bugfix] Token type and position embeddings fail to be applied to `inputs_embeds` (#25922)

DarkLight1337 committed 1 year ago

Verified 9f1c4eca

[Bugfix] Fix accuracy issue of TRTLLM FP8 MOE and improve logging (#25895)

pavanimajety committed 1 year ago

Verified ef283548

[Bugfix][Model] Fix inference for Hunyuan dense models (#25354)

Anionex committed 1 year ago

Verified f4db5e6d

Add Hugging Face Inference Endpoints guide to Deployment docs (#25886)

sergiopaniego committed 1 year ago

Verified 099aaee5

[Kernel][Moe Configs] Add more tuned triton configs for ExpertsInt8 and FP8 (#25858)

Josephasafg committed 1 year ago

Verified 35fe398c

[Fix] Improve CPU backend compatibility for RISC-V (#25816)

ihb2032 committed 1 year ago

Verified bb6d4304

[CI] Move applicable tests to CPU (#24080)

rzabarazesh committed 1 year ago

Verified bc546f76

[NIXL] Add support for MLA caches with different latent dim (#25902)

NickLucche committed 1 year ago

Verified 80608ba5

[perf] Use CPU tensor to reduce GPU->CPU sync (#25884)

lhtin committed 1 year ago

Verified e184c9c5

[Model] Move `vision_feature_select_strategy` into `resolve_visual_encoder_outputs` (#25938)

DarkLight1337 committed 1 year ago

Verified d7e34b42

[Bugfix][Model]fix ernie45 moe gate&bias dtype to float32 (#25936)

CSWYF3634076 committed 1 year ago

Verified ef6e0e71

Updated TRL integration docs (#25684)

sergiopaniego committed 1 year ago

Verified 1ad3aca6

[Doc] Add Cambricon MLU support (#25942)

a120092009 committed 1 year ago

Verified 8d0afa9b

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896)

zyongye committed 1 year ago

Verified fa7e254a

[Bugfix]: Clean up chunked prefill logging when using whisper (#25075)

simondanielsson committed 1 year ago

Verified e23cacda

[Model][Bugfix] Fix MiDashengLM audio encoder mask by removing incorrect `logical_not` (#25925)

zhoukezi committed 1 year ago

Verified 2e1b8bc2

[BugFix] Pass config_format via try_get_generation_config (#25912)

acisseJZhong committed 1 year ago

Verified e47433b3

[BugFix] Fix DP/EP hang (#25906)

LucasWilkinson committed 1 year ago

Verified 23194d83

Move`VllmConfig` from `config/__init__.py` to `config/vllm.py` (#25271)

hmellor committed 1 year ago

Verified 61aedb5f

[Benchmark] Support benchmark throughput for external launcher DP (#25913)

zhuohan123 committed 1 year ago

Verified d3bd1711

Newer Older