started migrating to Spark