VarianceScaling

class braintools.init.VarianceScaling(scale=1.0, mode='fan_in', distribution='normal', unit=None)

Base class for variance scaling initializations.

Variance scaling methods compute an appropriate scale factor based on the number of input and/or output units, then sample from a distribution with that scale.

Parameters:

• scale (Array | ndarray | bool | number | bool | int | float | complex | Quantity) – Scaling factor (positive float).

• mode (Literal['fan_in', 'fan_out', 'fan_avg']) – Mode for computing the scale factor: - ‘fan_in’: scale by number of input units - ‘fan_out’: scale by number of output units - ‘fan_avg’: scale by average of input and output units

• distribution (Literal['uniform', 'normal', 'truncated_normal']) – Distribution to sample from.