GitHub repository: AkshaySyal/Social-Network-Analysis-using-Spark-and-MapReduce
Primary language: Makefile
Created: 2024-04-16T20:14:07Z
Description: I analyzed a Twitter graph dataset with 11M nodes and 85M edges, calculating follower counts and social triangles using Spark and MapReduce. I explored various aggregation and join strategies, implemented on Hadoop and tested on AWS EMR. Optimization through data partitioning improved processing speed by 13%.