jax
9b3bbe83 - Adds an approximate=... keyword argument to jax.nn.gelu to select between the approximate and exact formulations of gelu.

Commit

5 years ago

Adds an approximate=... keyword argument to jax.nn.gelu to select between the approximate and exact formulations of gelu. Default to the approximate formulation for now.

References

#4438 - Adds an approximate=... keyword argument to jax.nn.gelu to select bet…

Author

hawkinsp

Parents

b609040c

jax 9b3bbe83 - Adds an approximate=... keyword argument to jax.nn.gelu to select between the approximate and exact formulations of gelu.

jax
9b3bbe83 - Adds an approximate=... keyword argument to jax.nn.gelu to select between the approximate and exact formulations of gelu.