vllm-project/vllm

Pull Requests Commits

Fast decode prepare path for prepare_inputs logic

alexm-redhat committed 1 year ago

79acf804

[Misc] Clean up Qwen2.5-Omni code (#17301)

DarkLight1337 committed 1 year ago

Verified 8b464d96

[Misc] Minor typo/grammar in `platforms/interface.py` (#17307)

NickLucche committed 1 year ago

Verified 889ebb26

[doc] update wrong model id (#17287)

reidliu41 committed 1 year ago

Verified 3ad986c2

[Bugfix] Add missing `get_language_model` to new MLLMs (#17300)

DarkLight1337 committed 1 year ago

Verified 344e193b

Add missing class docstring for `PromptAdapterConfig` (#17302)

hmellor committed 1 year ago

Verified fb1c933a

Update tpu_worker.py 's typo (#17288)

idouba committed 1 year ago

Verified 72c5b972

[Model] Add Granite Speech Support (#16246)

alex-jw-brooks committed 1 year ago

Verified fa93cd9f

[Core] Remove legacy input mapper/processor from V0 (#15686)

DarkLight1337 committed 1 year ago

Verified aec9674d

[Minor][Models] Pass partial_rotary_factor parameter to rope (#17266)

Eviannn committed 1 year ago

Verified 7fcc4223

[Misc] Validate `stop_token_ids` contents (#17268)

njhill committed 1 year ago

Verified 8262a3e2

[Doc] small fix (#17277)

reidliu41 committed 1 year ago

Verified f211331c

[Doc] Fix wrong github link in LMCache examples (#17274)

KuntaiDu committed 1 year ago

Verified 9053d0b1

[Bugfix] Fix Mistral3 spatial merge error (#17270)

mgoin committed 1 year ago

Verified cb3f2d8d

[Bugfix] Fix cutlass dispatch for fp8/int8 to properly invoke M<=16 c… (#16751)

Ther-LF committed 1 year ago

Verified c12df53b

[Bugfix] Fix missing ARG in Dockerfile for arm64 platforms (#17261)

lkm-schulz committed 1 year ago

Verified d1aeea75

[BugFix] Fix vllm_flash_attn install issues (#17267)

LucasWilkinson committed 1 year ago

Verified d8bccde6

[V1][Spec Decode] Make eagle compatible with prefix caching. (#17137)

LiuXiaoxuanPKU committed 1 year ago

Verified 20e489ea

[Metrics] Fix minor inconsistencies in bucket progression (#17262)

DarkLight1337 committed 1 year ago

Verified 4213475e

[doc] Add feature status legend (#17257)

reidliu41 committed 1 year ago

Verified d92879ba

[Feature] support sequence parallelism using compilation pass (#16155)

cascade812 committed 1 year ago

Verified 690fe019

[NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032)

kaixih committed 1 year ago

Verified ed7a29d9

[Bugfix] Fix Lora Name Parsing (#17196)

alex-jw-brooks committed 1 year ago

Verified 756848e7

[Misc] Change buckets of histogram_iteration_tokens to [1, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8096] to represent number of tokens (#17033)

sfc-gh-zhwang committed 1 year ago

Verified 18445edd

[MISC] Use string annotation types for class definitions (#17244)

jianzs committed 1 year ago

Verified 30215ca6

[Bugfix] Get a specific type of layer from forward context (#17222)

heheda12345 committed 1 year ago

Verified 838cedad

[Bugfix] Fix QWen2 VL multimodal mapping (#17240)

jeejeelee committed 1 year ago

Verified 4283a28c

[Misc] Make cached tokenizer pickle-compatible (#17048)

DarkLight1337 committed 1 year ago

Verified 93a126fb

[Kernel][Triton][FP8] Adding fp8 and variable length sequence support to Triton FAv2 kernel (#12591)

rasmith committed 1 year ago

Verified 8e4b351a

Update test_flash_attn.py (#17102)

ShuaibinLi committed 1 year ago

Verified 9869453c

Older