Fix divide-and-conquer when starting from a spectrum other than 0