Use n_embd_gqa instead of n_embd to handle llama-2 70B #2433
use n_embd_gqa instead of n_embd to handle llama-2 70B
0a8ad8f1
ggerganov
approved these changes
on 2023-07-28
ggerganov
merged
65cdf34b
into master 3 years ago
randxie
deleted the randxie/bug-fix branch 3 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub