brainstate.nn.mish#
- brainstate.nn.mish(x)[source]#
Mish activation function.
Mish is a self-regularized non-monotonic activation function.
\[\text{Mish}(x) = x * \text{Tanh}(\text{Softplus}(x))\]- Parameters:
x (
Array|ndarray|bool|number|bool|int|float|complex|Quantity) – Input array of any shape.- Returns:
Output array with the same shape as the input.
- Return type:
Array|Quantity
References