Need to guard changing annotation to millis so we don't do it again after the
initial load.