onnxruntime
63657609 - BiasDropoutFusion (#4167)

Commit
5 years ago
BiasDropoutFusion (#4167) * Implement BiasDropout Fusion and Kernel Dropout kernel for residual input BiasDropout Fusion to take residual input Fix BiasDropout Kernel Optimize DropoutGrad with 4 elements per thread * Add graph transformer UT * MLTypeCallDispatcher for RatioData * Use MLTypeDispatcher for ratio tensor * Handle traing_mode input for BiasDropout fusion * Add test case for missing ratio input * Replace using FinalizeNodeFusion * Make BiasDropout kernel template-less * Make DropoutGrad template-less * Make Dropout and TrainableDropout template-less * Regenerate onnx file for UT * Minior fix on divmod in BiasDropoutKernel * Adjust pt frontend test due to dropout randomnesss * Make dropout kernel opeartion in fp32 Co-authored-by: Sherlock Huang <bahuang@OrtTrainingDev3.af05slrtruoetgaxwwjv5nsq5e.px.internal.cloudapp.net>
Author
Parents
Loading