This should align with the start of `sorted_samples`