Integrated with Spark API