GitHub repository: Jaykold/StockPipeline
Primary language: Python
Created: 2025-03-25T01:17:23Z
Description: An end-to-end data engineering pipeline that extracts name, symbol, and stock data for multiple companies using yfinance, stores the raw data in Azure Data Lake, transforms it with PySpark, loads it into Azure SQL Server, and it is scheduled to run daily with Airflow and Power BI for visualization.