Starting to add the memorymanagement code.
Making allgather break - this is another instance of need ing to have symmetric memory for it to work...