GitHub repository: Kwame842/ECS_Event_Driven_Data_Pipeline
Primary language: Python
Description: This project implements a production-grade, event-driven data pipeline using AWS Step Functions, Fargate-based ECS tasks, and ephemeral compute resources. It dynamically provisions ECS clusters, runs containerized validation and transformation jobs, stores KPI results in DynamoDB, and performs full resource clean-up post-execution.