Localized Recompute for Gelu and AttentionDropout #4402
SherlockNoMad
merged
13 commits into
master
from
bahuang/gelu_recompute
Gelu Activation Recompute Draft
2ca52dcb
Prototype for localized recompute
3b848f59
Introduce localized_recompute rewriter
ad44253f
Merge branch 'master' into bahuang/gelu_recompute
cf18417b
Command line args for enabling recompute
7b65a619
SherlockNoMad
commented
on 2020-07-02
SherlockNoMad
commented
on 2020-07-02
SherlockNoMad
commented
on 2020-07-02
Minor fixes
044ed7a3
ke1337
commented
on 2020-07-02
ke1337
commented
on 2020-07-03
ke1337
commented
on 2020-07-03
Merge branch 'master' into bahuang/gelu_recompute
9c7372cc
Fix merge conflict
f8638d9b
Merge branch 'master' into bahuang/gelu_recompute
7ce92a0f
Add logger to Gradient Graph Builder
328a1b7c
Fix for Dropout Recompute
b4a7d4c2
ke1337
dismissed these changes
on 2020-08-04
SherlockNoMad
commented
on 2020-08-04
SherlockNoMad
commented
on 2020-08-04
SherlockNoMad
commented
on 2020-08-04
use const when possible
8f1fff16
ke1337
dismissed these changes
on 2020-08-04
Merge branch 'master' into bahuang/gelu_recompute
f50f7b82
ke1337
approved these changes
on 2020-08-05
Login to write a write a comment.
Login via GitHub