transformers

ef74b0f0 - get_activation('relu') provides a simple mapping from strings i… (#2807)

get_activation('relu') provides a simple mapping from strings i… (#2807) * activations.py contains a mapping from string to activation function * resolves some `gelu` vs `gelu_new` ambiguity