text-generation-inference
hotfix: Fix number of KV heads
#2202
Merged

hotfix: Fix number of KV heads #2202

danieldk merged 1 commit into main from bugfix/num-kv-heads
danieldk
danieldk Fix number of KV heads
10bbd7c5
danieldk danieldk merged cce475a9 into main 1 year ago
danieldk danieldk deleted the bugfix/num-kv-heads branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone