Preserve annotations and alert throttling beteen restarts