GitHub repository: vim89/datapipelines-essentials-python
Primary language: Python
Description: Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations