transformers
:red_circle: :red_circle: fix `query_pre_attn_scalar` different of `num_heads` in default gemma2 config
#34540
Merged
Merged
:red_circle: :red_circle: fix `query_pre_attn_scalar` different of `num_heads` in default gemma2 config #34540
molbap
merged
8 commits into
main
from
small_default_gemma2_fix
fix query_pre_attn_scalar different of num_heads in default config
e125fc82
propagate modular changes
d5680e09
fix copies
aaa85496
fix modular copies
8f9ab2f6
fix copies?
ae0f3d3d
ArthurZucker
approved these changes
on 2024-10-31
molbap
changed the title
correct copies fix
04e630cc
molbap
changed the title
Merge branch 'main' into small_default_gemma2_fix
40734653
Merge branch 'main' into small_default_gemma2_fix
661b671a
Login to write a write a comment.
Login via GitHub