NielsRogge/transformers

Pull Requests Commits

Bumping tokenizers dependency to 0.8.0.dev1 to check tests are passing.

mfuntowicz committed 4 years ago

6cdaff70

mfuntowicz committed 5 years ago

904119b9

Remove self._is_fast to avoid conflits with __getattr__()

mfuntowicz committed 5 years ago

353deb4f

Added pickle unittest for BatchEncoding

mfuntowicz committed 5 years ago

6580dbdd

Change property is_fast on BatchEncoding to be evaluated lazily to avoid lookup recursion through the dict

mfuntowicz committed 5 years ago

70947826

Added pickle support for Encoding & BatchEncoding

mfuntowicz committed 5 years ago

b1530b51

Correct tokens() return type to List[str]

mfuntowicz committed 5 years ago

664a04e9

Add flag to indicate if a BatchEncoding was generated from a fast tokenizer.

mfuntowicz committed 5 years ago

626727bd

[ci skip] Pin isort

julien-c committed 5 years ago

015f7812

TPU needs a rendezvous (#4339)

LysandreJik committed 5 years ago

Verified ef46ccb0

Add image and metadata (#4345)

ViktorAlm committed 5 years ago

Verified 94cb73c2

Add link to W&B to see whole training logs (#4348)

mrm8488 committed 5 years ago

Verified a0eebdc4

Release: v2.9.1

LysandreJik committed 5 years ago

7cb203fa

[Marian Fixes] prevent predicting pad_token_id before softmax, support language codes, name multilingual models (#4290)

sshleifer committed 5 years ago

Verified 9a687ebb

[Docs, Notebook] Include generation pipeline (#4295)

patrickvonplaten committed 5 years ago

Verified 839bfaed

wrong variable name used (#4328)

elyesmanai committed 5 years ago

Verified 2d184cb5

Question Answering for TF trainer (#4320)

jplu committed 5 years ago

Verified ca136186

Fix for #3865. PretrainedTokenizer mapped " do not" into " don't" when .decode(...) is called. Removed the " do not" --> " don't" mapping from clean_up_tokenization(...). (#4024)

lukovnikov committed 5 years ago

Verified 1e51bb71

(v2) Improvements to the wandb integration (#4324)

julien-c committed 5 years ago

Verified 24175910

Allow BatchEncoding to be initialized empty. (#4316)

mfuntowicz committed 5 years ago

Verified 7d7fe499

Update README.md (#4313)

savasy committed 5 years ago

Verified 0a97f631

Update README.md (#4315)

savasy committed 5 years ago

Verified 15a121fe

[model_cards]: 🇹🇷 Add new ELECTRA small and base models for Turkish (#4318)

stefan-it committed 5 years ago

Verified 15d45211

Add modelcard with acknowledgements (#4321)

ViktorAlm committed 5 years ago

Verified 8a017cbb

Fix BART tests on GPU (#4298)

julien-c committed 5 years ago

Verified 4bf50422

Add MultipleChoice to TFTrainer [WIP] (#4270)

ViktorAlm committed 5 years ago

Verified e4512aab

fixed missing torch module import (#4305)

lserinol committed 5 years ago

Verified 65be574a

Remove hard-coded pad token id in distilbert and albert (#3965)

monologg committed 5 years ago

Verified 31e67dd1

pin TF to 2.1 (#4297)

LysandreJik committed 5 years ago

Verified 30e34386

[ci] Restrict GPU tests to actual code commits

julien-c committed 5 years ago

Verified 56e8ef63

Older