Properly set the end of the day since we are not specifying end times for milestones