vllm
[Core] Support inplace model weights loading
#18745
Merged
Overview
Commits
7
Changes
View On GitHub

[Core] Support inplace model weights loading #18745

houseroad merged 7 commits into vllm-project:main from 22quinn:separate-weight-loading
22quinn
22quinn Inplace weights loading
9048f058
22quinn 22quinn requested a review from WoosukKwon WoosukKwon 200 days ago
22quinn 22quinn requested a review from robertgshaw2-redhat robertgshaw2-redhat 200 days ago
22quinn 22quinn requested a review from njhill njhill 200 days ago
22quinn 22quinn requested a review from ywang96 ywang96 200 days ago
22quinn 22quinn requested a review from comaniac comaniac 200 days ago
22quinn 22quinn requested a review from alexm-redhat alexm-redhat 200 days ago
github-actions
mergify mergify added v1
foreverlms
22quinn Handle tensorizer model loader
ca723d09
22quinn fixup
5955ece3
22quinn clean up
5dca53a2
22quinn
yeqcharlotte
yeqcharlotte commented on 2025-05-28
yeqcharlotte yeqcharlotte requested a review from youkaichao youkaichao 197 days ago
youkaichao
youkaichao commented on 2025-05-31
youkaichao
youkaichao approved these changes on 2025-05-31
houseroad
houseroad approved these changes on 2025-06-01
houseroad
22quinn Merge branch 'main' into separate-weight-loading
8833c4f6
22quinn address comments
be9789bd
22quinn unit test for inplace weights loading
598f4600
mergify mergify added tpu
22quinn
houseroad houseroad added ready
houseroad houseroad merged 9760fd8f into main 194 days ago
omrisapir1
houseroad
22quinn
22quinn
vadimkantorov
22quinn
vadimkantorov
22quinn
22quinn 22quinn deleted the separate-weight-loading branch 176 days ago
22quinn 22quinn restored the head branch 176 days ago
22quinn 22quinn deleted the separate-weight-loading branch 176 days ago
fxmarty-amd
foreverlms
vadimkantorov
22quinn 22quinn added rl

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
tpu ready v1 rl
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum