transformers
Fix 29807 sinusoidal positional encodings in Flaubert, Informer and XLM
#29904
Merged

Fix 29807 sinusoidal positional encodings in Flaubert, Informer and XLM #29904

hovnatan
hovnatan Fix sinusoidal_embeddings in FlaubertModel
786da4b4
hovnatan Fix for Informer
8f181a52
hovnatan Fix for XLM
538f2d2a
ArthurZucker
ArthurZucker commented on 2024-03-30
hovnatan Move sinusoidal emb for XLM
1bf96b70
hovnatan Move sinusoidal emb for Flaubert
4b2fc86c
hovnatan
hovnatan Small cleanup
ed44e69d
hovnatan hovnatan changed the title Fix 29807 sinusoidal positional encodings in Flauber, Informer and XLM Fix 29807 sinusoidal positional encodings in Flaubert, Informer and XLM 2 years ago
ArthurZucker
ArthurZucker commented on 2024-04-01
hovnatan Add comments on tests code copied from
15b6558c
ArthurZucker
ArthurZucker commented on 2024-04-01
hovnatan Add with Distilbert->
770c0899
ArthurZucker
ArthurZucker approved these changes on 2024-04-02
ArthurZucker ArthurZucker merged 416711c3 into main 2 years ago
hovnatan hovnatan deleted the fix_29807_pos_sine_encod_flauber_informer_xlm branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone