transformers
:red_circle: :red_circle: fix `query_pre_attn_scalar` different of `num_heads` in default gemma2 config
#34540
Merged

Commits
  • fix query_pre_attn_scalar different of num_heads in default config
    molbap committed 1 year ago
  • propagate modular changes
    molbap committed 1 year ago
  • fix copies
    molbap committed 1 year ago
  • fix modular copies
    molbap committed 1 year ago
  • fix copies?
    molbap committed 1 year ago
  • correct copies fix
    molbap committed 1 year ago
  • Merge branch 'main' into small_default_gemma2_fix
    molbap committed 1 year ago
  • Merge branch 'main' into small_default_gemma2_fix
    molbap committed 1 year ago
Loading