GitHub repository: vim89/datalake-etl-pipeline
Primary language: Python
Created: 2019-11-16T14:19:21Z
Description: Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations