PR #148 Fix glu activation

Fix glu activation #148

thomasw21 merged 6 commits into main from thomas/fix_glu_activation

Make sure to use glu activation when specified

e184e4bc

Woops forgot DS config

da332904

Upsample ffn_hidden_size when glu is used

c83529f9

Woops

a45d4a28

thomasw21 requested a review from

jaketae 4 years ago

thomasw21 requested a review from

stas00 4 years ago

stas00 approved these changes on 2021-10-21

Replace assert with raising exception instead

57deccb8

jaketae approved these changes on 2021-10-22

fix bug

f9dd27d3

thomasw21 merged bdc6ad6d into main 4 years ago

thomasw21 deleted the thomas/fix_glu_activation branch 4 years ago

Reviewers

jaketae

stas00

Assignees

No one assigned

Labels

None yet

Milestone

No milestone