transformers
86701f2b - :red_circle: :red_circle: fix `query_pre_attn_scalar` different of `num_heads` in default gemma2 config (#34540)

Commit

1 year ago

:red_circle: :red_circle: fix `query_pre_attn_scalar` different of `num_heads` in default gemma2 config (#34540) * fix query_pre_attn_scalar different of num_heads in default config * propagate modular changes * fix copies * fix modular copies * fix copies? * correct copies fix

References

#62 - Add initial DEIMv2 model implementation

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone

#39821 - Support MetaCLIP 2

#34540 - :red_circle: :red_circle: fix `query_pre_attn_scalar` different of `num_heads` in default gemma2 config

Author

molbap

Parents

4cc0813e

transformers 86701f2b - :red_circle: :red_circle: fix `query_pre_attn_scalar` different of `num_heads` in default gemma2 config (#34540)

transformers
86701f2b - :red_circle: :red_circle: fix `query_pre_attn_scalar` different of `num_heads` in default gemma2 config (#34540)