Some changes to how we updates referance times.