GitHub repository: JensRoland/aws-concurrent-data-orchestration-pipeline-emr-livy
Primary language: Python
Description: This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concurrent data pipeline by using Amazon EMR and Apache Livy. This pipeline is orchestrated by Apache Airflow.