llama.cpp
Use n_embd_gqa instead of n_embd to handle llama-2 70B
#2433
Merged

Use n_embd_gqa instead of n_embd to handle llama-2 70B #2433

ggerganov merged 1 commit into ggml-org:master from randxie/bug-fix
randxie
randxie use n_embd_gqa instead of n_embd to handle llama-2 70B
0a8ad8f1
ggerganov
ggerganov approved these changes on 2023-07-28
ggerganov ggerganov merged 65cdf34b into master 3 years ago
randxie randxie deleted the randxie/bug-fix branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone