Airflow at StyleSeat: Our journey, challenges & results
Channel: Apache Airflow
Date: 12/10/2023

Presented by Kunal Haria & Ramya Pappu at Airflow Summit 2023.

We will share the case study of Airflow at StyleSeat, where within a year our data grew from 2 million data points per day to 200 million. Our original solution for orchestrating this data was not enough, so we migrated to an Airflow based solution. Previous implementation Our tasks were orchestrated with hourly triggers on AWS Cloudwatch rules in their own log groups. Each task was a lambda individually defined as a task and executed python code from a docker image.