vllm

[WIP][Proof of concept] Overlap model loading and torch.compile

#36072

Open