With the current code you do get the different halos for the different sets. That's only to deal with the case where we running sequentially and hence the halo is `None` and halo exchange returns early.