Allow to remove objects that just group other objects.