Don't update when adding annotations if there was no change