vllm
[P/D Disaggregation] `PDController` and `PDWorker` Prototype (1p1d)
#15343
Open
Overview
Commits
50
Changes
View On GitHub

[P/D Disaggregation] `PDController` and `PDWorker` Prototype (1p1d) #15343

robertgshaw2-redhat wants to merge 50 commits into main from rob-fixes
robertgshaw2-redhat
panf2333 add test py
2a0cb780
panf2333 add vllm connect cmd
5d20f389
panf2333 add identity url headers
905424ed
panf2333 add /v1/completions stream support
bfde1688
panf2333 1. connect_parser set --prefill-addr and --decode-addr are required
6e1fba8a
panf2333 update disagg_connect test_request.py
b7ffb437
panf2333 Replace zmq.asyncio.Context().term() with zmq.asyncio.Context().destr…
897db7b9
panf2333 1. fix mypy issue
187f112c
panf2333 Run yapf and ruff
2c31e4c3
panf2333 1. replace tpc:// with ipc:// \n 2. fix json response
7fbf70db
panf2333 create proxy sockets in the proxy function for thread safety
ee660733
panf2333 fix ThreadProxy
27c1afe8
panf2333 run format.sh
8fa9df79
panf2333 add benchmark shell
16ed8273
panf2333 run format
6c8fae82
panf2333 remove invalid zmq benchmark code
298298f9
panf2333 change disagg_prefill example to use zmq
d6945ecd
panf2333 change log level and fix some comments
0cb2e052
panf2333 remove default socket address value
b9a7dbe7
panf2333 fix SIM105
4f13e891
panf2333 refactor disagg
912031ce
panf2333 refactor zmq msg to object
d35dace9
panf2333 fix mypy
c0b14433
panf2333 add unlimited HWM
8355358f
panf2333 fix rebase
b89d89f4
updated
a8a621e4
updated
9f7fb5ec
updated
2ceb7bc5
updated
120bbdfd
updated
85687b43
Stash
522279eb
Merge branch 'main' into rob-fixes
144162fc
updated
47a3f26b
working?
2fec6e0b
github-actions
mergify mergify added documentation
mergify mergify added frontend
updated
24cbbe47
cleanup
f6f008ca
updated
5d57896e
updated
2ba687d3
youkaichao
youkaichao commented on 2025-03-23
youkaichao
youkaichao commented on 2025-03-23
fix pre-commit
79e465f5
robertgshaw2-redhat robertgshaw2-redhat changed the title [P/D Disaggregation][Prototype] ZMQ Proxy [P/D Disaggregation][Prototype] Proxy 260 days ago
robertgshaw2-redhat pre-commit
f51f182d
robertgshaw2-redhat updated
cf64b0e6
robertgshaw2-redhat added files
2f29ae38
robertgshaw2-redhat updated
28d0396f
robertgshaw2-redhat updated
66349c33
robertgshaw2-redhat added __init__.py
d5b0db44
robertgshaw2-redhat added __init__.py
284d5df4
robertgshaw2-redhat updated
a10da866
robertgshaw2-redhat updated
7954461d
robertgshaw2-redhat robertgshaw2-redhat changed the title [P/D Disaggregation][Prototype] Proxy [P/D Disaggregation] ZMQ Controller and Worker 260 days ago
robertgshaw2-redhat updated
70e06dd5
robertgshaw2-redhat updated
220d6940
robertgshaw2-redhat robertgshaw2-redhat changed the title [P/D Disaggregation] ZMQ Controller and Worker [P/D Disaggregation] `PDController` and `PDWorker` Prototype 260 days ago
robertgshaw2-redhat robertgshaw2-redhat changed the title [P/D Disaggregation] `PDController` and `PDWorker` Prototype [P/D Disaggregation] `PDController` and `PDWorker` Prototype (1p1d) 260 days ago
panf2333
github-actions
github-actions github-actions added stale
puppetm4st3r
github-actions github-actions removed stale
github-actions github-actions added unstale
pplmx
mergify mergify added kv-connector

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
documentation frontend unstale kv-connector
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum