GitHub repository: virat02/Twitter-Small-World-PageRank
Primary language: Scala
Description: Analyzed a twitter dataset of 50,000 users, implementing a single-source shortest-path algorithm in both Scala and MapReduce, to corroborate the theory of six-degrees of separation. Developed an optimized PageRank Scala code, run for different input data sizes on AWS EMR clusters. Analyzed runtime, scale-up, speed-up, shuffled data, stages and lineage for optimization, using spark history server.