Maybe move this to a submap copy constructor or assignment operator?