ShardedDataParallelStrategy#
- class braintools.trainer.ShardedDataParallelStrategy(mesh=None, data_axis='data')#
Sharded data parallel strategy using jax.sharding.
Uses modern JAX sharding APIs for more flexible data distribution.
- Parameters:
Examples
>>> import braintools >>> strategy = braintools.trainer.ShardedDataParallelStrategy() >>> strategy.name 'sharded_data_parallel' >>> strategy.mesh.axis_names ('data',)
- property mesh: Mesh#
The device mesh.