[Core] Interface for accessing model from `VllmRunner` #10353
youkaichao
merged
36 commits into
vllm-project:main
from
DarkLight1337:get-model
Consolidate logic for directly accessing model
bc895d69
fix
17815cc1
DarkLight1337
changed the title
DarkLight1337
changed the title 
youkaichao
commented
on 2024-11-15
Fix not implemented
45510ee5
Merge branch 'main' into get-model
f512706c
Merge branch 'main' into get-model
177cc993
Fix
c06910ab
Update
b8e1f0b5
Fix
e4cb088b
Improve type annotation
b8c22b8f
Update new tests
6a0412c2
Add tests
3e37fe83
youkaichao
commented
on 2025-01-16
youkaichao
commented
on 2025-01-16
youkaichao
commented
on 2025-01-16
Just implement in base class
7d3f4056
youkaichao
commented
on 2025-01-16
todo
a4c29b77
Merge branch 'main' into get-model
f93abb2b
Fix
2104cd7b
Remove unnecessary test
e6985986
Reorganize docstrings
1c6e3d42
More cleanup
772ff129
Update
12750e2f
Simplify
9604678a
Make tensorizer work
103422f4
Avoid unnecessary redirection
b19c17ea
Fix
16fcf5d7
Cleanup
77535c40
format
32264f13
DarkLight1337
changed the title
youkaichao
commented
on 2025-01-19
youkaichao
commented
on 2025-01-19
youkaichao
commented
on 2025-01-19
Update comments
0be0251a
Merge branch 'main' into get-model
d8c7a7cd
Use `apply_to_model` instead of `get_torch_model`
d41c3606
Rename
0925e076
Make available to LLM
34566738
youkaichao
commented
on 2025-01-19
Fix type errors
ecac477b
Pass the function more explicitly
850b6e06
Update docstring
4ccd7065
youkaichao
approved these changes
on 2025-01-19
Fix missing concrete impl
5fb8b32a
Fix more spec decode workers
5e659fba
Update
2e966f0a
disabled auto-merge 1 year ago
Manually disabled by user
Manually disabled by user
Reviewers
Assignees
No one assigned
Labels
frontend
ready
Milestone
No milestone
Login to write a write a comment.
Login via GitHub