GitHub repository: spsoni/pyspark-delta-scd2
Primary language: Python
Created: 2023-06-22T04:32:35Z
Description: This project utilizes `faker-pyspark` to generate random schema and dataframes to mimic data table snapshots. Using these snapshots to process and apply SCD2 pattern into delta table as the destination.