mish#
- class brainstate.nn.mish(x)[source]#
Mish activation function.
Mish is a self-regularized non-monotonic activation function.
\[\text{Mish}(x) = x * \text{Tanh}(\text{Softplus}(x))\]- Parameters:
x (ArrayLike) – Input array of any shape.
- Returns:
Output array with the same shape as the input.
- Return type:
jax.Array or Quantity
References