brainstate.nn.soft_shrink

Contents

brainstate.nn.soft_shrink#

brainstate.nn.soft_shrink(x, lambd=0.5)[source]#

Soft shrinkage activation function.

Applies the soft shrinkage function element-wise:

\[\begin{split}\text{SoftShrinkage}(x) = \begin{cases} x - \lambda, & \text{ if } x > \lambda \\ x + \lambda, & \text{ if } x < -\lambda \\ 0, & \text{ otherwise } \end{cases}\end{split}\]
Parameters:

  • x (Array | ndarray | bool | number | bool | int | float | complex | Quantity) – Input array of any shape.

  • lambd (float) – The \(\lambda\) value for the soft shrinkage formulation. Must be non-negative. Default is 0.5.

Returns:

Output array with the same shape as the input.

Return type:

Array | Quantity

Contents