transformers
170fcaa6 - Generalize decay_mask_fn to apply mask to all LayerNorm params (#18273)

Commit

3 years ago

Generalize decay_mask_fn to apply mask to all LayerNorm params (#18273) * generalize decay_mask_fn to find all layernorm params * fixup * generalising decay_mask_fn

References

#18273 - Generalize decay_mask_fn to apply mask to all LayerNorm params

Author

duongna21

Parents

83d2d745

transformers 170fcaa6 - Generalize decay_mask_fn to apply mask to all LayerNorm params (#18273)

transformers
170fcaa6 - Generalize decay_mask_fn to apply mask to all LayerNorm params (#18273)