braintools.trainer.broadcast#
- braintools.trainer.broadcast(tensor, src=0, axis_name='batch', num_devices=None)[source]#
Broadcast tensor from source device to all devices.
- Parameters:
- Returns:
Broadcasted tensor.
- Return type:
Examples
>>> import jax >>> import jax.numpy as jnp >>> import braintools >>> x = jnp.arange(4.0) >>> jax.vmap(lambda v: braintools.trainer.broadcast(v, src=2), ... axis_name='batch')(x) Array([2., 2., 2., 2.], dtype=float32)