GitHub repository: sshyika/spark-s3-shuffle
Description: A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.