vllm
[WIP][Proof of concept] Overlap model loading and torch.compile
#36072
Open

[WIP][Proof of concept] Overlap model loading and torch.compile #36072

zou3519 wants to merge 1 commit into vllm-project:main from zou3519:overlap-compile-weights
zou3519
zou3519 [WIP] Overlap model loading and torch.compile
d3ed37ce
mergify mergify added frontend
mergify mergify added v1
zou3519 zou3519 changed the title [WIP] Overlap model loading and torch.compile [WIP][Proof of concept] Overlap model loading and torch.compile 12 days ago
gemini-code-assist
gemini-code-assist commented on 2026-03-05
miladm miladm requested a review from miladm miladm 11 days ago
Lucaskabela
zhxchen17
zou3519
zou3519
mergify
mergify mergify added needs-rebase

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone