GitHub repository: AymenRumi/remax-data-pipeline
Primary language: Python
Description: Python library for running multithreaded web scraping ETL workloads in celery, used for deploying and scheduling data pipeline with AWS lambda to run workers on EC2 instances for parallel execution.