Don't change sortBy.limit to unlimited when single slice optimization case