Remove entities that are not controlled