llama.cpp
fix: llama3.1 rope_freqs not respecting custom head_dim
#9141
Merged

fix: llama3.1 rope_freqs not respecting custom head_dim #9141

nyxkrage
nyxkrage fix: llama3.1 rope_freqs not respecting custom head_dim
b77d7f6f
github-actions github-actions added python
ghost
ghost approved these changes on 2024-08-23
ggerganov
ggerganov approved these changes on 2024-08-23
nyxkrage fix: use potential head_dim for Exaone
1a889197
kalomaze
drummerv
ggerganov ggerganov merged 75e1dbba into master 1 year ago
drummerv
drummerv
LostRuins

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone