One more minor optimization, now we don't divide the numbers by divisors that we know the number is evenly divisible by