Fix adjacent maps were not properly deactivated