updated spark version and added repartition