vllm_worker add multi-lora support #3136
wsvn53
wants to merge
6 commits into
lm-sys:main
from
wsvn53:vllm+multi-lora
vllm_worker supports multi-lora with the command line parameters --en…
338551de
add model_path basename as default model name
44237979
Run format.sh on vllm_worker.py
b9887a63
Add LoRA example in vllm integration document.
00b4d98e
bugfix when not using lora
6a937a42
Merge pull request #1 from oushu1zhangxiangxuan1/vllm+multi-lora
ab101962
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub