[ `gemma`] Adds support for Gemma 💎 #29167
ArthurZucker
merged
142 commits into
main
from
add-golden-gate
inital commit
7434ea28
update
61659253
update conversion checkpoint
69006fa5
update conversion script
cb801996
nits
08252ce2
some fixes
32ea5fb1
nits
888ab957
Merge branch 'add-golden-gate' of https://github.com/huggingface/new-…
ce0aa57e
merge
e303e482
fix permute
aefc4bcd
nits
78de9f5f
Merge branch 'add-golden-gate' of https://github.com/huggingface/new-…
fb2917df
fix
f3ad1b8f
nits
e3a0bbd1
nits
bbee069c
nits
e0e06463
fix rope
5f63b4c2
fix both rope
4734805b
merge
9b27edd1
nites
d20574d7
style
3f76b2ff
make sure flax works
3449b4bb
fix flax init code
fbbe1497
fix foward
bf8ed52f
nits
8273aa7f
print flax generation out
cf6345c5
current code
6f49e21f
nits
e2b09eed
SIIIIIIIIIIIIIIIIIII
94e1020a
update
afd89e85
add new tokenizer
f21564be
correct fast tokenizer
5c85aa32
fix conversion
342095bb
more comments
b6b6f356
fix modeling and conversion
f16f9b00
nits and nits
62077c32
nits testing
274aea77
add some tokenization tests
9e629dc9
add some edge cases
b128ceba
add slow tests and fix them
7bec5c60
fixup
51872ef8
fix copies for modeling
c8f89d24
fix copies
367cdcdc
add 7B slow tests
9fc4fd8a
fix
ea24f257
fix
e337cf2e
fix tests
b3565618
make tokenizer cis go green
423d0b1e
styling
ac8ee3d3
last tokenizer nits
ee4eebfd
update jax tests
06d3ff7f
fix flax for 7b
b7b31cac
add jit testing 🤗
7626e71c
cleanups
5db6ddc5
isolated nit, inv_freq for rotary_emb.inv_freq
5123d3cd
propagate to jax
ca759151
Apply suggestions from code review
36ecdc96
adjust test
792dcf01
Merge branch 'add-golden-gate' of https://github.com/huggingface/new-…
d700211e
fix conversion script
dbc976ef
change name
10ace9f0
correct file names
6ff459c6
Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad…
a5bb7a21
update conversion script
2126d1ca
Fix bos and eos token ids in the model configuration (#3)
ac7ac879
update modelling
bd2a7600
update conversion script
123d72c2
merge
aab31105
Merge remote-tracking branch 'gg/main' into HEAD
0d2acffc
add static cache for gemma
4e08dd9c
fix sdpa generate
6976cab7
fix batched
92c7a7f1
multiple fixes
f453a42e
fix FA2
491ea9ff
final fix
4b4b621f
Rename a few missing strings and filenames (#4)
e9d36beb
Merge branch 'main' into add-golden-gate
cdf93334
merge with upstream main
51a7d9f3
fix copies
89384e83
fix copies
648ef042
fix fixup
fd35d326
fix fixup
58d71465
fix
14d0f545
fix
3822c4c5
final tests
e50721d9
fix fx gemma tests
a7645433
fix fx bf16/fp16 tests
32a04921
update slow fx tests
069b8b57
fx slow tests: one logits, one generation
154e1df6
move jit test standalone
a4074b03
Merge commit '0996a10077219de0556281511fc02f3ab68002d5' into add-gold…
d7c2eb2d
Apply suggestions from code review
fc6ac3b7
nits
a259c041
Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad…
c590a9a8
tokenizer updates
b8d8edbf
more tokenization updates: custom GemmaSentencepieceExtrator
dc9ecf69
style
1a381bd8
Update src/transformers/cache_utils.py
f7496a48
Update src/transformers/models/gemma/__init__.py
170832a3
Update tests/models/gemma/test_modeling_flax_gemma.py
b32adc0d
small nits
24d5191f
Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad…
6d5a2feb
style
403c796f
update tokenization test
3633bb07
fix the rotary embedding
df865806
with style
565028aa
fix slow tests
362d2cda
WARNING this commit might be very important for precisions
fb87315a
Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad…
b63d2e00
Update tests/models/gemma/test_modeling_flax_gemma.py
9b834f76
Update src/transformers/models/gemma/configuration_gemma.py
e33fb3d0
Update src/transformers/models/gemma/modeling_flax_gemma.py
0aa94f11
small nits here and there!
e06809c2
Merge branch 'add-golden-gate' of github.com:huggingface/new-model-ad…
eb2c69dc
forgotten nit
db63274e
remove on the fly computation of inv_freq
275ee4a2
revert previous change, let's be safe and for now re-compute freq cis…
6d81a998
Apply suggestions from code review
c9a4d864
Update src/transformers/models/gemma/convert_gemma_weights_to_hf.py
1c42d4a3
Update src/transformers/models/gemma/convert_gemma_weights_to_hf.py
9c4d4391
Update tests/models/gemma/test_modeling_gemma.py
a56f5554
Update tests/models/gemma/test_modeling_gemma.py
03c8e8f5
Update tests/models/gemma/test_modeling_gemma.py
f37f517c
Update tests/models/gemma/test_modeling_flax_gemma.py
e5bfdd0e
Update tests/models/gemma/test_modeling_gemma.py
d83e0988
Update tests/models/gemma/test_modeling_gemma.py
09717b6b
Update tests/models/gemma/test_tokenization_gemma.py
cce69c0a
Update tests/models/gemma/test_tokenization_gemma.py
dde30a5f
Update tests/models/gemma/test_tokenization_gemma.py
02a2d38b
Update tests/models/gemma/test_tokenization_gemma.py
c975dae8
Update tests/models/gemma/test_modeling_gemma.py
5cf4da3c
Update tests/models/gemma/test_modeling_gemma.py
f1980155
Update tests/models/gemma/test_modeling_gemma.py
ac82e00a
Update tests/models/gemma/test_modeling_gemma.py
7253c9ff
Update tests/models/gemma/test_modeling_gemma.py
bc7ebaf7
nit conversion script link
4ad0d523
younesbelkada
approved these changes
on 2024-02-21
fix some tests
7db13fad
add not doctest and pr doctest
60f8ba6a
Merge branch 'add-golden-gate' of github.com:huggingface/transformers…
1bf51b30
repo consistency
2a4d326f
fix last CIs 🚀
ea9eb109
update all readmes
556f743b
Login to write a write a comment.
Login via GitHub