Fix SafeMode when there's more rows than the InferRows limit