NielsRogge/transformers

Pull Requests Commits

First draft for VisionEncoderDecoder

NielsRogge committed 3 years ago

bc766aae

Add final layernorm and projection

NielsRogge committed 3 years ago

8eb2d428

Make decoder outputs correct for first step

NielsRogge committed 3 years ago

de55ff5c

Convert weights of decoder

NielsRogge committed 3 years ago

a28cb228

Fix decoder inputs

NielsRogge committed 3 years ago

3f524fbe

Add decoder embeddings, layernorm and output bias

NielsRogge committed 3 years ago

9fab6b8f

Make projection MLP work

NielsRogge committed 3 years ago

823a2b2a

Add Seq2SeqLMOutput

NielsRogge committed 3 years ago

bd0dd7b3

Add Pix2SeqProjection

NielsRogge committed 3 years ago

d0f0ab8d

Make forward pass work until transformer encoder

NielsRogge committed 3 years ago

bebcf11f

Improve conversion script

NielsRogge committed 3 years ago

73e5ee68

Improve conversion script

NielsRogge committed 3 years ago

1cd91e20

NielsRogge committed 3 years ago

5bb6ccc3

NielsRogge committed 3 years ago

528613cd

Fix hashing for deduplication (#17048)

thomasw21 committed 3 years ago

Verified db034660

Remove device parameter from create_extended_attention_mask_for_decoder (#16894)

pbelevich committed 3 years ago

Verified 39f8eafc

Remove fetch in model templates test

sgugger committed 3 years ago

dd739f70

Fix RNG reload in resume training from epoch checkpoint (#17055)

sgugger committed 3 years ago

Verified 1c9fcd0e

Remove Python and use v2 action (#17059)

sgugger committed 3 years ago

Verified 6e17ba6a

Make Trainer compatible with sharded checkpoints (#17053)

sgugger committed 3 years ago

Verified a8fa2f91

Move test model folders (#17034)

ydshieh committed 3 years ago

Verified 19420fd9

[FlaxBert] Add ForCausalLM (#16995)

sanchit-gandhi committed 3 years ago

Verified cd9274d0

[T5 Tokenizer] Model has no fixed position ids - there is no hardcode… (#16990)

patrickvonplaten committed 3 years ago

Verified 31616b8d

Clean up setup.py (#17045)

sgugger committed 3 years ago

Verified 1073f00d

Make the sacremoses dependency optional (#17049)

LysandreJik committed 3 years ago

Verified 30ca5299

Allow all imports from transformers (#17050)

LysandreJik committed 3 years ago

Verified bb2e088b

Add YOLOS (#16848)

NielsRogge committed 3 years ago

Verified 1ac69874

Fix no_trainer examples to properly calculate the number of samples (#17046)

muellerzr committed 3 years ago

Verified f275e593

Update no_trainer examples to use new logger (#17044)

muellerzr committed 3 years ago

Verified 35d48db8

[Trainer] Move logic for checkpoint loading into separate methods for easy overriding (#17043)

calpt committed 3 years ago

Verified daecae1f

Older