vllm-project/vllm

Pull Requests Commits

Merge remote-tracking branch 'origin/main' into il_tool

luccafong committed 1 year ago

e793b9a7

adjust config type and remove config path for simplicity

luccafong committed 1 year ago

76c9ec0d

[Hardware][IBM Z] Fix Outlines Core issue for s390x (#24034)

R3hankhan123 committed 1 year ago

Verified e10fef08

[Bugfix] Disable the statslogger if the api_server_count is greater than 1 (#22227)

chaunceyjiang committed 1 year ago

Verified e680723e

[Attention] FlashAttention MLA cudagraph support (#23958)

MatthewBonanni committed 1 year ago

Verified 620db1fc

[Spec Decode] Fix offline spec_decode.py (#24257)

ekagra-ranjan committed 1 year ago

Verified 41183c1f

[Model loader]: support multi-thread model weight loading (#23928)

BraveY committed 1 year ago

Verified 43d9ad03

[CI] Enable encoder model compilation test (#24442)

ZJY0516 committed 1 year ago

Verified 7be141b2

[Model] Remove quantized mixtral (#24437)

jeejeelee committed 1 year ago

Verified 8d7f39b4

[Spec Decode][Benchmark] Add Blitzedit dataset (#23605)

ekagra-ranjan committed 1 year ago

Verified cd086369

[Spec Decode][Benchmark] Add Spec Bench Dataset for benchmarking (#23563)

ekagra-ranjan committed 1 year ago

Verified 3feeeb9f

[Model] Enable BNB support for qwen2_5_omni_thinker (#24420)

jeejeelee committed 1 year ago

Verified 6f4a82f8

[Docs]add eplb_config param use docs (#24213)

lengrongfu committed 1 year ago

Verified c44797a4

[Doc]: fix 2 hyperlinks leading to Ray site after they changed Ray's doc structure (#24438)

didier-durand committed 1 year ago

Verified 55be93ba

[Docs] Move feature compatibility tables to README (#24431)

hmellor committed 1 year ago

Verified 717fc00e

[Frontend] User-provided uuids for medias in chat. (RFC #22044) (#23449)

huachenheli committed 1 year ago

Verified 01dfb5e9

Move `KVEventsConfig` from `config/__init__.py` to `config/kv_events.py` (#24433)

hmellor committed 1 year ago

Verified 03dd652c

[Misc] Terratorch related fixes (#24337)

christian-pinto committed 1 year ago

Verified 9cd76b71

[Bugfix] Fix mamba2 prefill chunking (#23279)

tomeras91 committed 1 year ago

Verified e0413141

[Bugfix] Fix get_quant_config when using modelscope (#24421)

Potabk committed 1 year ago

Verified 5e537f45

[Doc] Fix issues in integrations/llamastack.md (#24428)

windsonsea committed 1 year ago

Verified c2a8b08f

[Doc]: fix typos in Python comments (#24417)

didier-durand committed 1 year ago

Verified f4962a6d

[Docs] Fix a tip indentation and typo (#24419)

windsonsea committed 1 year ago

Verified 2f0b833a

[gpt-oss][Responses API] Fix the function call id format (#24409)

chaunceyjiang committed 1 year ago

Verified 425b04b8

[Model] Remove unnecessary CUDA sync of Qwen2VL image and video preprocess (#24334)

what-in-the-nim committed 1 year ago

Verified 60f0843e

[Model] Remove unnecessary CUDA sync of GLM-4.1V image and video preprocess (#24332)

what-in-the-nim committed 1 year ago

Verified 8a466026

[P/D] Add a shutdown method to the Connector API (#22699)

chaunceyjiang committed 1 year ago

Verified 61aa4b29

[Doc] Fix UTF-8 encoding issues in documentation generation on Windows (#24361)

alhridoy committed 1 year ago

Verified 8c892b18

[CI/Build] Fix local image inputs in test_pixtral.py (#24401)

huachenheli committed 1 year ago

Verified 3bca396f

[CI/Build] Disable flaky test_structured_output tests (#24404)

22quinn committed 1 year ago

Verified 3a3e91bd

Older