jax
c18d765c - Move epsilon term in optimizers.rmsprop into sqrt

Commit
6 years ago
Move epsilon term in optimizers.rmsprop into sqrt The TensorFlow rmsprop code puts epsilon into the sqrt. This makes a large difference on e.g. Deep RL settings, which tend to use very large values of epsilon.
Author
Parents
Loading