Remove time series points not common to all.