Ensure that runs are deterministic even across different parallelization strategies. Loss / Parameters / Outputs must be the same.