GitHub repository: ragu-762-git/Automate-Dataflow-Workloads-Using-Cloud-Composer
Primary language: Python
Description: A daily scheduled DAG extracts the data from an API and upload it to the GCS bucket in CSV format. Once the file hits the bucket, Event Arc trigger executes the dataflow pipeline, which transforms the data to JSON strings and write to BigQuery