transformers
Fix precision errors from casting rotary parameters to FP16 with AMP
#27700
Merged

Fix precision errors from casting rotary parameters to FP16 with AMP #27700

ArthurZucker merged 10 commits into huggingface:main from fix-einsum-amp
kevinhu
kevinhu Update modeling_llama.py
643098a9
kevinhu Update modeling_open_llama.py
cd763d21
kevinhu Update modeling_gpt_neox.py
659b8fc3
kevinhu Update modeling_mistral.py
9dfac9e0
kevinhu Update modeling_persimmon.py
d3aef861
kevinhu Update modeling_phi.py
3f81d376
kevinhu kevinhu changed the title Fix precision errors from casting rotary parameters to FP16 with AMP in Llama Fix precision errors from casting rotary parameters to FP16 with AMP 2 years ago
kevinhu Update modeling_falcon.py
db4c79fe
kevinhu Update modeling_gpt_neox_japanese.py
d00f0868
ArthurZucker
ArthurZucker commented on 2023-11-27
kevinhu Merge branch 'huggingface:main' into fix-einsum-amp
ecaf5121
ArthurZucker
ArthurZucker commented on 2023-11-28
ArthurZucker
ArthurZucker approved these changes on 2023-11-28
HuggingFaceDocBuilderDev
kevinhu Merge branch 'huggingface:main' into fix-einsum-amp
3f171917
ArthurZucker ArthurZucker merged 083e3692 into main 2 years ago
ArthurZucker

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone