Upgraded to spark 1.0