vllm
[BugFix] Fix Embedding Models with TP>1
#5075
Merged

[BugFix] Fix Embedding Models with TP>1 #5075

simon-mo merged 1 commit into main from fix-embedding-with-tp
robertgshaw2-redhat
fix embedding model + tp
799147a4
robertgshaw2-redhat robertgshaw2-redhat marked this pull request as ready for review 1 year ago
robertgshaw2-redhat robertgshaw2-redhat requested a review from simon-mo simon-mo 1 year ago
zhuohan123
zhuohan123 approved these changes on 2024-05-27
robertgshaw2-redhat robertgshaw2-redhat enabled auto-merge (squash) 1 year ago
mgoin
mgoin approved these changes on 2024-05-28
robertgshaw2-redhat
disabled auto-merge 1 year ago
Manually disabled by user
simon-mo simon-mo merged 9ba41558 into main 1 year ago
simon-mo simon-mo deleted the fix-embedding-with-tp branch 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone