vllm
Support S3 Sharded loading with RunAI Model Streamer
#16317
Merged
Overview
Commits
3
Changes
View On GitHub

Support S3 Sharded loading with RunAI Model Streamer #16317

vllm-bot merged 3 commits into vllm-project:main from omer/runai-model-streamer-sharded
omer-dayan
github-actions
omer-dayan omer-dayan changed the title Support Sharded loading with RunAI Model Streamer Support S3 Sharded loading with RunAI Model Streamer 247 days ago
omer-dayan Support Sharded loading with RunAI Model Streamer
c447ec36
DarkLight1337
DarkLight1337 commented on 2025-04-10
DarkLight1337 DarkLight1337 requested a review from WoosukKwon WoosukKwon 246 days ago
omer-dayan omer-dayan requested a review from DarkLight1337 DarkLight1337 236 days ago
omer-dayan Update vllm/model_executor/model_loader/loader.py
78264e4b
DarkLight1337 DarkLight1337 added ready
DarkLight1337
omer-dayan Merge branch 'vllm-project:main' into omer/runai-model-streamer-sharded
23a3fe1d
DarkLight1337
DarkLight1337 approved these changes on 2025-04-22
vllm-bot vllm-bot merged 71ce4404 into main 234 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum