vllm
[Offloader] Offload submodules that make_layers never reaches
#53120
Merged
Overview
Commits
4
Changes
View On GitHub

[Offloader] Offload submodules that make_layers never reaches #53120

Isotr0py merged 4 commits into vllm-project:main from ray24777:feat/qwen3-5-vision-tower-offload
ray24777
github-actions
mergify mergify added qwen
ray24777 ray24777 force pushed 53 days ago
ray24777 ray24777 marked this pull request as ready for review 53 days ago
ray24777 ray24777 requested a review from sighingnow sighingnow 53 days ago
ray24777 ray24777 requested a review from vadiklyutiy vadiklyutiy 53 days ago
ray24777 ray24777 requested a review from DarkLight1337 DarkLight1337 53 days ago
ray24777 ray24777 requested a review from ywang96 ywang96 53 days ago
ray24777 ray24777 requested a review from AndreasKaratzas AndreasKaratzas 53 days ago
claude
claude commented on 2026-08-20
DarkLight1337 DarkLight1337 requested a review from youkaichao youkaichao 53 days ago
DarkLight1337 DarkLight1337 requested a review from Isotr0py Isotr0py 53 days ago
ray24777 ray24777 force pushed 53 days ago
ray24777 ray24777 force pushed 53 days ago
ray24777 ray24777 force pushed 52 days ago
Isotr0py
Isotr0py commented on 2026-08-22
ray24777 ray24777 force pushed 51 days ago
ray24777 ray24777 marked this pull request as draft 50 days ago
ray24777 [Offloader] Offload submodules that make_layers never reaches
03584c33
ray24777 ray24777 force pushed to 03584c33 50 days ago
ray24777 ray24777 changed the title [Model] Route the Qwen3.5 vision tower through the UVA offloader [Offloader] Offload submodules that make_layers never reaches 50 days ago
ray24777 ray24777 marked this pull request as ready for review 50 days ago
ray24777 ray24777 requested a review from 22quinn 22quinn 50 days ago
claude
claude commented on 2026-08-24
Isotr0py clean impl
6df44731
Isotr0py
Isotr0py approved these changes on 2026-08-26
Isotr0py Isotr0py enabled auto-merge (squash) 48 days ago
github-actions github-actions added ready
Isotr0py
mergify[bot] Merge branch 'main' into feat/qwen3-5-vision-tower-offload
9f02ede2
github-actions
ray24777 [CI/Build] Increase GPU memory utilization for Qwen 3.5 in test_tower…
f60471e6
disabled auto-merge 48 days ago
Head branch was pushed to by a user without write access
ray24777
ray24777
github-actions
Isotr0py Isotr0py merged 61d4f566 into main 48 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready qwen
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum