GitHub repository: rachit-mishra/PyScrub
Primary language: Python
Description: Built on the powerful PySpark framework and packaged within a Docker environment, PyScrub offers a scalable, flexible, and efficient way to cleanse and profile large datasets. Whether you're dealing with inconsistencies, missing values, or you need to understand your data's structure and quality at a glance, PyScrub is here to help.