Evaluating Altmetrics Acts Through Their Creators – How To Advance?
Creators: name: Lemke, Steffen
name: Mehrazar, Maryam
name: Peters, Isabella
name: Mazarakis, Athanasios
Publisher: name: Zenodo
Year: 2017
Subjects: metrics
altmetrics
social media
academic research
web science
information retrieval

description: One of the grand challenges in the meaningful use and interpretation of altmetrics is the heterogeneity of the acts behind them (Haustein, 2016). On the one hand, the diversity of the online interactions as a measure of scholarly impact is part of what makes altmetrics such a promising complement to traditional impact measures. On the other hand, this diversity makes the interpretation of altmetrics a difficult endeavor, as altmetrics derived from different social media platforms are shaped by significantly different premises. Although different actions on those platforms are in many cases fundamentally different regarding both the respective user’s degree of involvement and intention, their scores are displayed side by side by altmetrics providers without much further explanation of their diverse premises. For example, bookmarking a publication in Mendeley has a substantially different meaning from writing a post about the same publication in Facebook. In order to account for semantic differences between acts from different sources for altmetrics, efforts have been made to classify interactions regarding the required degree of involvement (Haustein, Bowman, &amp; Costas, 2016) or their stakeholders’ main use cases („NISO RP-25-2016, Outputs of the NISO Alternative Assessment Project - National Information Standards Organization“, 2016). One largely unexplored premise that should be considered when interpreting altmetrics are differences regarding the platforms’ userships – the users that are responsible for the interactions underlying altmetrics. Referring to past studies, the share of academics among the users interacting with scientific articles seems to vary considerably between platforms: while for example Jin-Cheon Na &amp; Yingxin Estella Ye (2017) found a distinct predominance of non-academic users in discussions of psychological academic articles on Facebook, Vainio &amp; Holmberg (2017) found researchers to be strongly represented among Twitter users responsible for tweeting scientific articles. And even for those platforms for which we can assume that the relevant share of interactions with scientific publications is committed by researchers such as Mendeley and ResearchGate (Sugimoto, Work, Larivière, &amp; Haustein, 2016), there still might be considerable differences regarding the overall researchers’ professional experience, productivity in terms of traditional publications or represented fields of research between individual platforms. 

The differentiation between the semantics of acts in altmetrics – and their weighting based on this differentiation – leads to many questions regarding a sensible methodology and also its overall desirableness.
description: {"references": ["Haustein, S. (2016). Grand challenges in altmetrics: heterogeneity, data quality and dependencies. Scientometrics, 108(1), 413\u2013423. https://doi.org/10.1007/s11192-016-1910-9", "Haustein, S., Bowman, T. D., &amp; Costas, R. (2016). Interpreting 'Altmetrics': Viewing Acts on Social Media through the Lens of Citation and Social Theories. In C. R. Sugimoto (Hrsg.), Theories of Informetrics and Scholarly Communication. Berlin, Boston: De Gruyter. https://doi.org/10.1515/9783110308464-022", "Jin-Cheon Na, &amp; Yingxin Estella Ye. (2017). Content analysis of scholarly discussions of psychological academic articles on Facebook. Online Information Review, 41(3), 337\u2013353. https://doi.org/10.1108/OIR-02-2016-0058", "NISO RP-25-2016, Outputs of the NISO Alternative Assessment Project - National Information Standards Organization. (n. Y.). Retrieved on 24th January 2017, from http://www.niso.org/apps/group_public/document.php?document_id=17091&amp;wg_abbrev=altmetrics", "Sugimoto, C. R., Work, S., Larivi\u00e8re, V., &amp; Haustein, S. (2016). Scholarly use of social media and altmetrics: a review of the literature. Journal of the Association for Information Science and Technology, 68: 2037\u20132062. https://doi.org/10.1002/asi.23833", "Vainio, J., &amp; Holmberg, K. (2017). Highly tweeted science articles: who tweets them? An analysis of Twitter user profile descriptions. Scientometrics. https://doi.org/10.1007/s11192-017-2368-0"]}