llm-foundry

15e79f38 - Make the ffn activation func configurable (#805)

Make the ffn activation func configurable (#805) * config ffn_act_fn v0 * irene pr comments * enable config to have function * updt test * dblalock pr comments * updt how default ffn_act config is set