GitHub repository: pajagtap/data-reporting
Primary language: Python
Created: 2023-03-01T12:18:56Z
Description: Repo uses docker-compose file to create docker container to run hadoop, hive and spark. Notes.txt file has details about implementation. This repo covers end-to-end simple flow, reading parquet files to spark-df and loading it to csv-file and run unit-test-cases.