Partitioned mpi forward propagation implementation