vllm-project/vllm

Pull Requests Commits

LiuXiaoxuanPKU committed 1 year ago

b73fdb92

[Security] Don't bind tcp zmq socket to all interfaces (#17197)

russellb committed 1 year ago

Verified a0304dc5

Explicitly explain quant method override ordering and ensure all overrides are ordered (#17256)

hmellor committed 1 year ago

Verified c7941cca

Make name of `compressed-tensors` quant method consistent across vLLM (#17255)

hmellor committed 1 year ago

Verified b6dd32aa

Improve conversion from dataclass configs to argparse arguments (#17303)

hmellor committed 1 year ago

Verified f9488694

[Docs] Add a security guide (#17230)

russellb committed 1 year ago

Verified 72dfe4c7

[Misc] Clean up Qwen2.5-Omni code (#17301)

DarkLight1337 committed 1 year ago

Verified 8b464d96

[Misc] Minor typo/grammar in `platforms/interface.py` (#17307)

NickLucche committed 1 year ago

Verified 889ebb26

[doc] update wrong model id (#17287)

reidliu41 committed 1 year ago

Verified 3ad986c2

[Bugfix] Add missing `get_language_model` to new MLLMs (#17300)

DarkLight1337 committed 1 year ago

Verified 344e193b

Add missing class docstring for `PromptAdapterConfig` (#17302)

hmellor committed 1 year ago

Verified fb1c933a

Update tpu_worker.py 's typo (#17288)

idouba committed 1 year ago

Verified 72c5b972

[Model] Add Granite Speech Support (#16246)

alex-jw-brooks committed 1 year ago

Verified fa93cd9f

[Core] Remove legacy input mapper/processor from V0 (#15686)

DarkLight1337 committed 1 year ago

Verified aec9674d

[Minor][Models] Pass partial_rotary_factor parameter to rope (#17266)

Eviannn committed 1 year ago

Verified 7fcc4223

[Misc] Validate `stop_token_ids` contents (#17268)

njhill committed 1 year ago

Verified 8262a3e2

[Doc] small fix (#17277)

reidliu41 committed 1 year ago

Verified f211331c

[Doc] Fix wrong github link in LMCache examples (#17274)

KuntaiDu committed 1 year ago

Verified 9053d0b1

[Bugfix] Fix Mistral3 spatial merge error (#17270)

mgoin committed 1 year ago

Verified cb3f2d8d

[Bugfix] Fix cutlass dispatch for fp8/int8 to properly invoke M<=16 c… (#16751)

Ther-LF committed 1 year ago

Verified c12df53b

[Bugfix] Fix missing ARG in Dockerfile for arm64 platforms (#17261)

lkm-schulz committed 1 year ago

Verified d1aeea75

[BugFix] Fix vllm_flash_attn install issues (#17267)

LucasWilkinson committed 1 year ago

Verified d8bccde6

[V1][Spec Decode] Make eagle compatible with prefix caching. (#17137)

LiuXiaoxuanPKU committed 1 year ago

Verified 20e489ea

[Metrics] Fix minor inconsistencies in bucket progression (#17262)

DarkLight1337 committed 1 year ago

Verified 4213475e

[doc] Add feature status legend (#17257)

reidliu41 committed 1 year ago

Verified d92879ba

[Feature] support sequence parallelism using compilation pass (#16155)

cascade812 committed 1 year ago

Verified 690fe019

[NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032)

kaixih committed 1 year ago

Verified ed7a29d9

[Bugfix] Fix Lora Name Parsing (#17196)

alex-jw-brooks committed 1 year ago

Verified 756848e7

[Misc] Change buckets of histogram_iteration_tokens to [1, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8096] to represent number of tokens (#17033)

sfc-gh-zhwang committed 1 year ago

Verified 18445edd

[MISC] Use string annotation types for class definitions (#17244)

jianzs committed 1 year ago

Verified 30215ca6

Older