Create part of the infrastructure for overlapping computation and
communication