squareplus

Contents

squareplus#

class brainstate.nn.squareplus(x, b=4)[source]#

Squareplus activation function.

Computes the element-wise function:

\[\mathrm{squareplus}(x) = \frac{x + \sqrt{x^2 + b}}{2}\]
Parameters:
  • x (Array | ndarray | bool | number | bool | int | float | complex | Quantity) – Input array.

  • b (Array | ndarray | bool | number | bool | int | float | complex | Quantity) – Smoothness parameter. Default is 4.

Returns:

An array with the same shape as the input.

Return type:

Array | Quantity

References