# Language Bias in the Google Scholar Ranking Algorithm
## 4 Results
Analysis of Scatter Plots to Show the Differ Ranking Pattern of Documents Written in Languages other than English  
The different ranking pattern presented by documents written in languages other than English is also evident in the scatter plots (Figures 1-4), where the documents published in English are represented by gray dots and those corresponding to other languages are represented by red dots. The blue dots represent the median values of the ranking by citations of the documents listed among the top thousand in the results page. As is evident, the vast majority of the results corresponding to documents written in languages other than English (red dots) do not appear in the top 900 positions. There are, in fact, two \begin{table}
\begin{tabular}{c c c c c c c c c} \hline \hline \multicolumn{1}{c}{} & \multicolumn{6}{c}{**Correlations for Searches by Keywords**} \\ \hline
**Keyword** & \multicolumn{3}{c}{**All Results**} & \multicolumn{3}{c}{**Results for English**} & \multicolumn{3}{c}{**Results for Non-English**} \\ \cline{2-10}  & \#Items & **R** & \(p\)**-Value** & \#Items & **R** & \(p\)**-Value** & \#Items & **R** & \(p\)**-Value** \\ \hline capital & 1000 & 0.4418 & 0.00000 & 960 & 0.4939 & 0.00000 & 40 & 0.0908 & 0.57740 * \\ \hline combustible & 990 & 0.7532 & 0.00000 & 924 & 0.8568 & 0.00000 & 66 & 0.3047 & 0.01287 \\ \hline crisis & 1000 & 0.4950 & 0.00000 & 973 & 0.5199 & 0.00000 & 27 & \(-\)0.1713 & 0.39291 * \\ \hline cultural & 999 & 0.3792 & 0.00000 & 950 & 0.4178 & 0.00000 & 49 & \(-\)0.0201 & 0.89107 * \\ \hline exterior & 1000 & 0.6286 & 0.00000 & 908 & 0.7293 & 0.00000 & 92 & \(-\)0.0705 & 0.50417 * \\ \hline federal & 1000 & 0.5872 & 0.00000 & 963 & 0.5736 & 0.00000 & 37 & \(-\)0.0445 & 0.79361 * \\ \hline festival & 1000 & 0.8446 & 0.00000 & 962 & 0.8661 & 0.00000 & 38 & 0.3535 & 0.02948 * \\ \hline final & 1000 & 0.5770 & 0.00000 & 975 & 0.5874 & 0.00000 & 25 & 0.0514 & 0.80732 * \\ \hline general & 999 & 0.4012 & 0.00000 & 953 & 0.4161 & 0.00000 & 46 & 0.1698 & 0.25934 * \\ \hline idea & 999 & 0.7966 & 0.00000 & 940 & 0.8829 & 0.00000 & 59 & 0.2875 & 0.02725 \\ \hline invisible & 1000 & 0.6922 & 0.00000 & 963 & 0.7492 & 0.00000 & 37 & 0.0934 & 0.58233 * \\ \hline moral & 1000 & 0.5502 & 0.00000 & 958 & 0.5868 & 0.00000 & 42 & \(-\)0.0086 & 0.95691 * \\ \hline popular & 1000 & 0.6121 & 0.00000 & 914 & 0.6763 & 0.00000 & 86 & \(-\)0.0022 & 0.98379 * \\ \hline social & 1000 & 0.2335 & 0.00000 & 970 & 0.2561 & 0.00000 & 30 & 0.6076 & 0.00037 \\ \hline terror & 1000 & 0.7719 & 0.00000 & 958 & 0.7872 & 0.00000 & 42 & 0.0189 & 0.90535 * \\ \hline Total & 14,987 & & & 14,271 & & & 716 & & \\ \hline Median & 1000 & 0.9180 & 0.00000 & 996 & 0.9412 & 0.00000 & 151 & 0.0549 & 0.50301 * \\ \hline \end{tabular}
\end{table} 
Table 8: Correlations between ranking by citations and the GS native ranking for searches by keyword. \begin{table}
\begin{tabular}{c c c c c c c c c c} \hline \hline \multicolumn{1}{c}{} & \multicolumn{6}{c}{**Correlations for All Searches**} \\ \hline  & \multicolumn{3}{c}{**All Results**} & \multicolumn{3}{c}{**Results for English**} & \multicolumn{3}{c}{**Results for Non-English**} \\ \cline{2-10}  & \#Items & **R** & \(p\)**-Value** & \#Items & **R** & \(p\)**-Value** & \#Items & **R** & \(p\)**-Value** \\ \hline All searches & 1000 & 0.9171 & 0.0000 & 998 & 0.9797 & 0.0000 & 321 & 0.1803 & 0.0012 \\ \hline \end{tabular}
\end{table} 
Table 9: Correlations between median rank positions by citations and the GS native ranking for all searches conducted. Figure 4: Scatter plot of all searches. Figure 3: Scatter plot of searches by keyword. Documents in languages other than English do not adhere to the pattern set by the overall results, a pattern that places the points along the diagonal of the scatter plot, corresponding to a high correlation coefficient. A pattern that gives a good position in the ranking according to the number of citations received also gives a good position in the Google Scholar native ranking.