[`Persimmon`] Add support for persimmon #26042
intiial commit
2ae1f2e8
updates
aec340fd
nits
388eca73
update conversion script
59532763
update conversion script
480dcbd5
use path to load
69f9e607
add tips etc
ab8d7af9
Merge branch 'add-persimmon' of https://github.com/arthurzucker/tran…
a736fdc2
some modeling logic
a5eb7a01
modeling update
ad6cf905
more nits
4720c664
Merge branch 'add-persimmon' of https://github.com/arthurzucker/trans…
3f76bac0
nits
4b66644f
normal layer norm
57f39382
update config and doc
437c1157
nits
1fb2f115
update doc remove unused
38f4f74e
update
4e88e7ac
fix inits and stuff
a6fd8028
fixup
f9832d73
revert wrong changes
51b06c31
updates
d01c417c
more nits
b67fdbbd
add default config values to the configuration file
c59ae4d4
fixup happy
5fcd3406
update
de84aec9
2 tests left
71c0aec2
update readmes
b411bcf3
more nits
334ca300
slow test and more documentation
2cad2454
update readme
4882cb0c
fix licences
96202c4d
ArthurZucker
marked this pull request as ready for review 2 years ago
styling
45b6eb20
use fast if possible when saving tokenizer
0bb51303
remove todo
1936ba64
remove tokenization tests
b1249311
small last nits
70f5af3d
Apply suggestions from code review
adb090bf
nits to skip the timout doctest
4d918ff6
fix integration test
cbc1ee43
fix test
c460ea85
update eos token
a12a3199
update to allow fast tokenization
16aeecfa
styling
9c9a2750
fix codeLlama as well for the update post processor
3f861269
Apply suggestions from code review
5bbc4345
add more copied from statements
5143b33f
update
24959d1c
doc passes doctest
8e87a0ef
remove `# final layer norm?`
454c48f1
change docstring prompot
9fb6179a
sgugger
approved these changes
on 2023-09-08
Merge branch 'main' of https://github.com/huggingface/transformers in…
6d0aff2a
update
e3dd8d7b
Update README.md
32e5cab9
don't doctest the conversion script as it requires more packages
16aab81d
don't init a model in the config
c1b5e129
oups
1181a30b
fix doctest
e93cc2d7
Merge branch 'main' of https://github.com/huggingface/transformers in…
fb37f3fb
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub