text-generation-inference
marlin: support tp>1 when group_size==-1
#2032
Merged

marlin: support tp>1 when group_size==-1 #2032

danieldk merged 1 commit into main from feature/marlin-groupsize-1-tp
danieldk
danieldk marlin: support tp>1 when group_size==-1
b9eb57f9
Narsil
Narsil approved these changes on 2024-06-06
Narsil
Narsil commented on 2024-06-06
danieldk danieldk merged 0d96468e into main 1 year ago
danieldk danieldk deleted the feature/marlin-groupsize-1-tp branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone