adds jais2 model support (#42684)
* adds jais2 model support
* updates tests
* addresses review comment
* review comments addressed
* addresses test review comments
* fixes date
* format issue fix
* Update src/transformers/models/jais2/__init__.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* Update src/transformers/models/jais2/modular_jais2.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* Update tests/models/jais2/test_modeling_jais2.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* Update src/transformers/models/jais2/modular_jais2.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* Update src/transformers/models/jais2/modular_jais2.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* Update src/transformers/models/jais2/modular_jais2.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* Update src/transformers/models/jais2/modular_jais2.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* Update src/transformers/models/jais2/modular_jais2.py
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* fixes tests as per review comment
* updates layernorm setup
* Apply suggestions from code review
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
* addressed review comments and updated tests as recomended
* fixup tests
---------
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
Co-authored-by: vasqu <antonprogamer@gmail.com>