huggingface/transformers

Pull Requests Commits

Revert "Replace placeholder tokens as specified in added_tokens_decoder"

itazap committed 68 days ago

8a293c84

Replace placeholder tokens as specified in added_tokens_decoder

itazap committed 68 days ago

64b0f05b

ArthurZucker committed 69 days ago

e3d30250

Merge branch 'bad_models_update' of github.com:huggingface/transformers into bad_models_update

ArthurZucker committed 69 days ago

8039c2b6

ArthurZucker committed 69 days ago

47a772ae

itazap committed 69 days ago

969c0fc6

Merge branch 'bad_models_update' of github.com:huggingface/transformers into bad_models_update

ArthurZucker committed 69 days ago

2710fadf

ArthurZucker committed 69 days ago

a4fc098f

nllb and test tok common read spm precompiled charsmap

itazap committed 69 days ago

083ec509

ArthurZucker committed 69 days ago

31ff32d2

ArthurZucker committed 69 days ago

db0c5b58

extract the charsmap

ArthurZucker committed 69 days ago

2159e92f

ArthurZucker committed 69 days ago

4d068711

ArthurZucker committed 69 days ago

5c8af86f

ArthurZucker committed 69 days ago

34d83ed7

itazap committed 69 days ago

0c958427

itazap committed 69 days ago

b512fc70

itazap committed 69 days ago

ceeb3197

itazap committed 69 days ago

d5e9aba1

itazap committed 69 days ago

a7c2435b

itazap committed 69 days ago

08b91c68

itazap committed 69 days ago

df12cc4e

undo changes to big bird , bert, seamless

itazap committed 69 days ago

8bf6df09

Revert "missed the most important files"

itazap committed 69 days ago

e5c8a2f7

missed the most important files

itazap committed 69 days ago

cbda0cac

itazap committed 69 days ago

47457459

fixing models so AutoTokenizer == TokenizersBackend - aligning with converters

itazap committed 69 days ago

53753c31

more feedback updates!

itazap committed 69 days ago

be29c606

tiktoken.model test

itazap committed 69 days ago

7d46f77f

other modular fixes

itazap committed 69 days ago

95bba6ca

Older