Keep track of annotations showing the hit test area to re-display after zooms