Don't init the scales to the smallest.