# Leveraging Social Network Analysis for Crowdsourced Software Engineering Research
## 4 Results
### Citation Network Analysis
\begin{table}
\begin{tabular}{c c c c c c c} \hline \hline
**Rank** & **PID** & **Publication Title** & **Authors** & **Year** & **Category** & **Number of Citations** \\ \hline \multirow{2}{*}{1} & \multirow{2}{*}{P486} & Two’s Company, Three’s a Crowd: & \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON]}} & \multirow{2}{*}{2014} & \multirow{2}{*}{General} & \multirow{2}{*}{87} \\  & & A Case Study of Crowdsourcing & & & & & \\  & & Software Development & & & & & \\ \hline \multirow{2}{*}{2} & \multirow{2}{*}{P29} & A Survey of the Use of & \multirow{2}{*}{[PERSON], [PERSON], \multirow{2}{*}{[PERSON], [PERSON]}} & \multirow{2}{*}{2017} & \multirow{2}{*}{General} & \multirow{2}{*}{75} \\  & & Crowdsourcing in Software & & & & & \\ \hline \multirow{2}{*}{3} & \multirow{2}{*}{P185} & Engineering: Models, Motivations, & \multirow{2}{*}{[PERSON]} & \multirow{2}{*}{2019} & \multirow{2}{*}{General} & \multirow{2}{*}{56} \\  & & and Challenges & & & & \\ \hline \multirow{2}{*}{4} & \multirow{2}{*}{P463} & TopCoder (A): Developing & \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON]}}} & \multirow{2}{*}{2010} & \multirow{2}{*}{General} & \multirow{2}{*}{52} \\  & & Software through Crowdsourcing & & & & & \\ \hline \multirow{2}{*}{5} & \multirow{2}{*}{P215} & Developer Recommendation for & \multirow{2}{*}{[PERSON], [PERSON], \multirow{2}{*}{[PERSON], [PERSON], \multirow{2}{*}{[PERSON]}}} & \multirow{2}{*}{2015} & \multirow{2}{*}{General} & \multirow{2}{*}{44} \\  & & Crowdsourced Software & & & & & \\ \multicolumn{2}{c}{} & Development Tasks & & & & & \\ \hline \multirow{2}{*}{6} & \multirow{2}{*}{P328} & Money, Glory and Cheap Talk: & \multirow{2}{*}{[PERSON]} & \multirow{2}{*}{2010} & \multirow{2}{*}{General} & \multirow{2}{*}{41} \\  & & Analyzing Strategic Behavior of & \multirow{2}{*}{[PERSON]} & \multirow{2}{*}{2010} & \multirow{2}{*}{General} & \multirow{2}{*}{41} \\  & & Contestants in Simultaneous & \multirow{2}{*}{Crowdsourcing Contests on & & & & \\  & & TopCoder.com & & & & \\ \hline \multirow{2}{*}{7} & \multirow{2}{*}{P181} & Crowdsourcing for & \multirow{2}{*}{[PERSON], [PERSON], \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON]}}} & \multirow{2}{*}{2012} & Software & \multirow{2}{*}{38} \\  & & Usability Testing & & & & \\ \hline \multirow{2}{*}{8} & \multirow{2}{*}{P324} & Microtask Programming: Building & \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON]}}}} & \multirow{2}{*}{2014} & \multirow{2}{*}{Coding} & \multirow{2}{*}{37} \\  & & Software with a Crowd & & & & \\ \hline \multirow{2}{*}{9} & \multirow{2}{*}{P356} & Pricing Crowdsourcing-Based & \multirow{2}{*}{[PERSON], [PERSON], \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON]}}} & \multirow{2}{*}{2013} & \multirow{2}{*}{General} & \multirow{2}{*}{33} \\  & & Software Development Tasks & & & & \\ \hline \multirow{2}{*}{10} & \multirow{2}{*}{P149} & CrowdOracles: Can the Crowd & \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON], \multirow{2}{*}{[PERSON]}}} & \multirow{2}{*}{2013} & Software & \multirow{2}{*}{31} \\  & & Solve the Oracle Problem? & & & & \\ \hline \hline \end{tabular}
\end{table} 
Table 15: The 10 most frequently cited CSE publications. Figure 14: Outgoing and ingoing links. Figure 13: The CSE citation network. \begin{table}
\begin{tabular}{c|c c} \hline
**Cluster \#** & **Color** & **Number of Publications** & **Publications Cited Most Frequently** \\ \hline
1 & 116 & P181 \\ \hline
2 & 47 & P324 \\ \hline
3 & 78 & P441 \\ \hline
4 & 12 & P448 \\ \hline
5 & 104 & P29 \\ \hline
6 & 133 & P486 \\ \hline
7 & 19 & P366 \\ \hline \end{tabular}
\end{table} 
Table 16: Clusters of citation networks. P29 had the highest degree centrality (degree centrality = 197, ingoing links = 75, outgoing links = 122). This means it had the highest citation relationship with other publications in the network, indicating that it was frequently cited by other publications and that it cited many other publications.