Fix error when removing last annotation.