Fix race condition issue in RNN/LSTM/GRU (#1544)
Fix race condition issue in RNN/LSTM/GRU.
Description:
The filter_desc and rnn_desc could also be changed in compute which could be in multi-thread. It will cause race condition issue.
Fix:
create temperate cudnn descriptors
cache cudnn_dropout_desc_ which won't change
