You should make batches smaller than 1024 by default, because some objects users work with might be very large. I'd set it to only 10. If you'd like, you can add an optional batchSize parameter to RDD.saveAsPickleFile.