Track alerts over time and write out alert timeseries.