Darkpipe is Spark RDDs implemented on the Disco distributed compute pipeline.