llama.cpp
Fix backward rope after YaRN
#3974
Merged

Fix backward rope after YaRN #3974

xaedes
xaedes fix backward process of rope
ff0a3645
xaedes fix finetune rope call to use correct default attn_factor of 1.0f
93e65d32
xaedes remove unused `ggml_rope_xpos_back`
926930ba
xaedes fix comments explaining the sinus sign in ggml_forward_rope
3490a17b
xaedes add missing function arguments in declaration
ad83e416
xaedes fix function argument type in declaration
a352d40b
cebtenzzre
cebtenzzre approved these changes on 2023-11-06
cebtenzzre
CoruNethron
ggerganov
ggerganov approved these changes on 2023-11-07
ggerganov ggerganov merged e9c1cecb into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone