GitHub repository: naresy/Data-Reading-From-CSV-file-Using-Scala-and-PySpark
Primary language: Scala
Description: Developed a scalable data pipeline using Scala and PySpark to efficiently read and process large CSV files. The project involved loading data into Spark DataFrames, applying schema definitions, and performing transformations for data analysis in a distributed computing environment."