the rs could theoretically be at the exact same timestamp, and we should still add it.