Separate BuildScales from SlidingWindow