PR #805 Make the ffn activation func configurable

Make the ffn activation func configurable #805

vchiley merged 9 commits into mosaicml:main from vchiley:cfg_ffn_act

config ffn_act_fn v0

589ba6a7

vchiley marked this pull request as ready for review 2 years ago

vchiley requested a review from

sashaDoubov 2 years ago

vchiley requested a review from

irenedea 2 years ago

vchiley requested a review from

dakinggg 2 years ago

Merge branch 'main' into cfg_ffn_act

02459ec2

irenedea commented on 2023-12-14

irene pr comments

f7c02e65

vchiley force pushed to f7c02e65 2 years ago

Merge branch 'main' into cfg_ffn_act

87305dfe

enable config to have function

8aad57f7

sashaDoubov commented on 2023-12-14

vchiley requested a review from

dblalock 2 years ago

vchiley force pushed to 8aad57f7 2 years ago

sashaDoubov approved these changes on 2023-12-14

updt test

70f87167

dblalock commented on 2023-12-14

dblalock pr comments

635ab48d

Merge branch 'main' into cfg_ffn_act

96b6330b

vchiley requested a review from

irenedea 2 years ago

irenedea approved these changes on 2023-12-15

irenedea commented on 2023-12-15

updt how default ffn_act config is set

b1b250b5

vchiley enabled auto-merge (squash) 2 years ago

vchiley merged 15e79f38 into main 2 years ago

vchiley deleted the cfg_ffn_act branch 2 years ago

Reviewers

irenedea

sashaDoubov

dblalock

dakinggg

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

llm-foundry Make the ffn activation func configurable #805 Merged

Make the ffn activation func configurable #805

llm-foundry
Make the ffn activation func configurable
#805

Merged