Gemma capping #34282
ArthurZucker
merged
58 commits into
main
from
gemma-capping
kashif
commented
on 2024-10-21
softcapping
85d549a7
soft cap before the mask
eba51917
style
b9e4a54c
...
514a8394
super nit
7544febb
update
be1b8c38
fixes
0e0511f8
update
03ccc224
small issue with modular
bdda7245
fix modular imports
a2b6b12a
update
9365c1b7
fixup
2108ee3a
simplify a hell lot
520120a1
vasqu
commented
on 2024-10-22
simplify cleaning imports
314ed1f4
finish fixing
88304738
update our design
e4c19d7a
nits
7922210a
Merge branch 'main' of github.com:huggingface/transformers into gemma…
fa1319d6
use a deprecation cycle
43c68f66
updates
1aec9445
Fix modular (recursive deps need to always be computed after merges!)
93b53efd
Merge branch 'gemma-capping' of github.com:huggingface/transformers i…
6f3cabb0
push
a79c4a94
fix
4c6d2990
update
607c45df
fix modular order
4598bba4
make fix-copies
57272703
updates
198b4c48
update
3d35151f
?
da050cdd
don't compile for now
e02078ca
?
5861bbf5
fix some stuff
8c47da2e
donc!
09a88d93
fix copies
c06b5306
update
89e6f859
fixup
152e0b77
Merge branch 'main' of github.com:huggingface/transformers into gemma…
46d8fa7b
?
006e8693
fix two tests
159c65a2
fix?
56ea5b90
for now, don't use head info
4c3deb9d
eager when output attentoin and sdpa or flash as it's the simplest be…
9e3609d0
fix-copies
21edaedc
revert sdpa check
b5d98194
Apply suggestions from code review
5a3dadee
Merge branch 'main' of github.com:huggingface/transformers into gemma…
faf433b0
rebase, fix-copies and push
1da75e11
add a slow integration test
aca9120a
update the test
8f1fc5ea
fix left padding issue
5be3babd
fix test
3e5b87a9
remove duplicate scaling
0513aff0
quality
480aff81
Merge branch 'main' into gemma-capping
603fce82
add a small test and make sure it works
2a765d6e
Merge branch 'gemma-capping' of github.com:huggingface/transformers i…
fb184bec
2b
6aba68c0
Login to write a write a comment.
Login via GitHub