Add more stability to latency predictor