vllm
[Dockerfile][KVConnector] Add LMCache support with native C++ compilation to Dockerfile
#50971

Closed

[Dockerfile][KVConnector] Add LMCache support with native C++ compilation to Dockerfile #50971

Snagwick wants to merge 43 commits into vllm-project:main from UnieAI:kenn/add-lmcache

ngram_dsc v4

56968420

Add Optuna support for tuning vLLM serve parameters

f2ffdbaa

Merge pull request #1 from UnieAI/nctu6/ngram-dsc

d55c7fea

Add UnieAI license verification and entrypoint

d099d322

fix: extend optuna range in serve_optuna.py

73fe7ed5

Added common requirements for unieinfra inference

7b18cb5c

Refactor _start_best_server to use ServerProcess and handle after_ben…

49c5f3b2

Merge pull request #3 from UnieAI/ZoneTwelve/unieai-license

1f65b3c8

merge vllm/main and update install.sh

a5108ef2

Merge pull request #4 from UnieAI/nctu6/merge_vllm_main_20260423

d305d7a3

dflash+dsc-v4

186a060a

dflash+dsc-v5: if context length >= 4K, use normal decode

ea33163c

launch with kv offload

21d0fdd5

Revert "launch with kv offload"

11424e06

Merge pull request #5 from UnieAI/nctu6/dflash-dsc

8dd31d94

Hopper + Blackwell support

7e08fea1

integrate dsc into mtp

9a735b78

mtp+dsc-v3

9e993aeb

Merge pull request #6 from UnieAI/kenn/hopper

a30fac63

Merge branch 'main' into nctu6/mtp-dsc

e3caf28a

merge_vllm_main_20260512

f6c1128f

fix install.sh and config

516fe2c7

mtp+dsc-v5

9d53c0d1

Merge branch 'nctu6/mtp-dsc' into nctu6/merge_vllm_main_20260512

bf490a25

[Bugfix][V1][TurboQuant] Fall back to torch.empty when workspace is l…

b8c50be7

[Bugfix][V1][TurboQuant] Pre-reserve decode workspace at backend init

984cf97c

[Test][V1] WorkspaceManager lock semantics + try_get_simultaneous

8022e88c

[Bugfix][V1] WorkspaceManager.reserve sizes every ubatch slot

cc51817e

[Bugfix][V1][TurboQuant] Use WorkspaceManager.reserve in _reserve_dec…

5e7f3e3f

[Test][V1] Cover WorkspaceManager.reserve across multiple ubatch slots

91b936f7

Merge branch 'pr-42551' into merge-pr-42551

02b71bc2

Merge pull request #8 from UnieAI/nctu6/merge_vllm_main_20260512

bf94fe28

Merge remote-tracking branch 'vllm/main' into nctu6/merge_vllm_main_2…

6bcba52b

add rust module

cf34b64b

Merge pull request #9 from UnieAI/nctu6/merge_vllm_main_20260527

07095d34

merge_vllm_main_20260630

e7a47b82

merge_vllm_main_20260730

2acef054

remove dsc (conflict) to run dspark first (to merge later) and fix e…

1dcde6c6

merge_vllm_main_20260708

fc3b795d

Merge pull request #12 from UnieAI/nctu6/merge_vllm_main_20260708

4ad14044

merge_vllm_main_20260729

408ffb6b

Merge pull request #13 from UnieAI/nctu6/merge_vllm_main_20260729

b7e42f2c

feat: add LMCache build setup and source files

dccb2711