Don't allocate metrics unless number of x <= number of xi