transformers
Generalize decay_mask_fn to apply mask to all LayerNorm params
#18273

Merged

Generalize decay_mask_fn to apply mask to all LayerNorm params #18273

sanchit-gandhi merged 3 commits into huggingface:main from duongna21:fix-decay-mask-for-layernorm

generalize decay_mask_fn to find all layernorm params

9fa9f26b

fixup

a6d580b4

sgugger approved these changes on 2022-07-26

patrickvonplaten approved these changes on 2022-07-27

sanchit-gandhi approved these changes on 2022-07-27

generalising decay_mask_fn

8653ed45

sanchit-gandhi merged 170fcaa6 into main 3 years ago

Reviewers

sanchit-gandhi

patrickvonplaten

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone