added Spark for realtime and batch