vllm-project/vllm

Pull Requests Commits

accepted length code

LiuXiaoxuanPKU committed 281 days ago

bc3b20f8

record entropy and prob

LiuXiaoxuanPKU committed 316 days ago

54be44ee

record entropy and prob

LiuXiaoxuanPKU committed 316 days ago

2815bd61

add mtbench dataste

LiuXiaoxuanPKU committed 316 days ago

17bccecb

LiuXiaoxuanPKU committed 1 year ago

c335930d

[Security] Don't bind tcp zmq socket to all interfaces (#17197)

russellb committed 1 year ago

Verified a0304dc5

Explicitly explain quant method override ordering and ensure all overrides are ordered (#17256)

hmellor committed 1 year ago

Verified c7941cca

Make name of `compressed-tensors` quant method consistent across vLLM (#17255)

hmellor committed 1 year ago

Verified b6dd32aa

Improve conversion from dataclass configs to argparse arguments (#17303)

hmellor committed 1 year ago

Verified f9488694

[Docs] Add a security guide (#17230)

russellb committed 1 year ago

Verified 72dfe4c7

[Misc] Clean up Qwen2.5-Omni code (#17301)

DarkLight1337 committed 1 year ago

Verified 8b464d96

[Misc] Minor typo/grammar in `platforms/interface.py` (#17307)

NickLucche committed 1 year ago

Verified 889ebb26

[doc] update wrong model id (#17287)

reidliu41 committed 1 year ago

Verified 3ad986c2

[Bugfix] Add missing `get_language_model` to new MLLMs (#17300)

DarkLight1337 committed 1 year ago

Verified 344e193b

Add missing class docstring for `PromptAdapterConfig` (#17302)

hmellor committed 1 year ago

Verified fb1c933a

Update tpu_worker.py 's typo (#17288)

idouba committed 1 year ago

Verified 72c5b972

[Model] Add Granite Speech Support (#16246)

alex-jw-brooks committed 1 year ago

Verified fa93cd9f

[Core] Remove legacy input mapper/processor from V0 (#15686)

DarkLight1337 committed 1 year ago

Verified aec9674d

[Minor][Models] Pass partial_rotary_factor parameter to rope (#17266)

Eviannn committed 1 year ago

Verified 7fcc4223

[Misc] Validate `stop_token_ids` contents (#17268)

njhill committed 1 year ago

Verified 8262a3e2

[Doc] small fix (#17277)

reidliu41 committed 1 year ago

Verified f211331c

[Doc] Fix wrong github link in LMCache examples (#17274)

KuntaiDu committed 1 year ago

Verified 9053d0b1

[Bugfix] Fix Mistral3 spatial merge error (#17270)

mgoin committed 1 year ago

Verified cb3f2d8d

[Bugfix] Fix cutlass dispatch for fp8/int8 to properly invoke M<=16 c… (#16751)

Ther-LF committed 1 year ago

Verified c12df53b

[Bugfix] Fix missing ARG in Dockerfile for arm64 platforms (#17261)

lkm-schulz committed 1 year ago

Verified d1aeea75

[BugFix] Fix vllm_flash_attn install issues (#17267)

LucasWilkinson committed 1 year ago

Verified d8bccde6

[V1][Spec Decode] Make eagle compatible with prefix caching. (#17137)

LiuXiaoxuanPKU committed 1 year ago

Verified 20e489ea

[Metrics] Fix minor inconsistencies in bucket progression (#17262)

DarkLight1337 committed 1 year ago

Verified 4213475e

[doc] Add feature status legend (#17257)

reidliu41 committed 1 year ago

Verified d92879ba

[Feature] support sequence parallelism using compilation pass (#16155)

cascade812 committed 1 year ago

Verified 690fe019

Older