Only update the end_time on the initial scan