GitHub repository: judeleonard/Prescriber-ETL-data-pipeline
Primary language: Python
Created: 2022-12-05T06:42:39Z
Description: An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS application using Apache Airflow as an orchestration tool and various data warehouse technologies and finally using Apache Superset to connect to DWH for generating BI dashboards for weekly reports