pinecone/core-2020-05-10-deduplication huggingface dataset:
A method for eliminating articles by homonymous authors from the large number of articles retrieved by author search

This paper proposes a methodology which discriminates the articles by the target authors (“true” articles) from those by other homonymous authors (“false” articles). Author name searches for 2,595 “source” authors in six subject fields retrieved about 629,000 articles. In order to extract true articles from the large amount of the retrieved articles, including many false ones, two filtering stages were applied. At the first stage any retrieved article was eliminated as false if either its affiliation addresses had little similarity to those of its source article or there was no citation relationship between the journal of the retrieved article and that of its source article. At the second stage, a sample of retrieved articles was subjected to manual judgment, and utilizing the judgment results, discrimination functions based on logistic regression were defined. These discrimination functions demonstrated both the recall ratio and the precision of about 95% and the accuracy (correct answer ratio) of 90–95%. Existence of common coauthor(s), address similarity, title words similarity, and interjournal citation relationships between the retrieved and source articles were found to be the effective discrimination predictors. Whether or not the source author was from a specific country was also one of the important predictors. Furthermore, it was shown that a retrieved article is almost certainly true if it was cited by, or cocited with, its source article. The method proposed in this study would be effective when dealing with a large number of articles whose subject fields and affiliation addresses vary widely.This is a preprint of an article published in Journal of the American Society for Information Science and TechnologyVolume 62, Issue 4, pages 677–690, April 2011.http://onlinelibrary.wiley.com/doi/10.1002/asi.21491/abstrac
Exploiting Navigational Queries for Result Presentation and Caching in Web Search Engines

Cataloged from PDF version of article.Caching of query results is an important mechanism for efficiency and scalability of web search engines. Query results are cached and presented in terms of pages, which typically include 10 results each. In navigational queries, users seek a particular website, which would be typically listed at the top ranks (maybe, first or second) by the search engine, if found. For this type of query, caching and presenting results in the 10-per-page manner may waste cache space and network bandwidth. In this article, we propose nonuniform result page models with varying numbers of results for navigational queries. The experimental results show that our approach reduces the cache miss count by up to 9.17% (because of better utilization of cache space). Furthermore, bandwidth usage, which is measured in terms of number of snippets sent, is also reduced by 71% for navigational queries. This means a considerable reduction in the number of transmitted network packets, i.e., a crucial gain especially for mobile-search scenarios. A user study reveals that users easily adapt to the proposed result page model and that the efficiency gains observed in the experiments can be carried over to real-life situations
Information Search and Retrieval in Microblogs

Modern information retrieval (IR) has come to terms with numerous new media in efforts to help people find information in increasingly diverse settings. Among these new media are so-called microblogs. A microblog is a stream of text that is written by an author over time. It comprises many very brief updates that are presented to the microblog's readers in reverse-chronological order. Today, the service called Twitter is the most popular microblogging platform. Although microblogging is increasingly popular, methods for organizing and providing access to microblog data are still new. This review offers an introduction to the problems that face researchers and developers of IR systems in microblog settings. After an overview of microblogs and the behavior surrounding them, the review describes established problems in microblog retrieval, such as entity search and sentiment analysis, and modeling abstractions, such as authority and quality. The review also treats user-created metadata that often appear in microblogs. Because the problem of microblog search is so new, the review concludes with a discussion of particularly pressing research issues yet to be studied in the field.published or submitted for publicationis peer reviewe
Social media and migration: virtual community 2.0

Research indicates
that migrants' social media usage in Ireland enables a background awareness of
friends and acquaintances that supports bonding capital and transnational
communities in ways not previously reported. Interview data from 65 Polish and
Filipino non-nationals in Ireland provide evidence that their social media
practices enable a shared experience with friends and relations living outside
Ireland that is not simply an elaboration of the social relations enabled by
earlier Internet applications. Social media usage enables a passive monitoring
of others, through the circulation of voice, video, text, and pictures, that
maintains a low level mutual awareness and supports a dispersed community of
affinity. This ambient, or background, awareness of others enhances and
supports dispersed communities by contributing to bonding capital. This may
lead to significant changes in the process of migration by slowing down the process
of integration and participation in host societies while also encouraging
continual movement of migrants from one society to another
Discovering latent topical structure by second-order similarity analysis

This is the post-print of the Article - Copyright @ 2011 ASIS&TDocument similarity models are typically derived from a term-document vector space representation by comparing all vector-pairs using some similarity measure. Computing similarity directly from a ‘bag of words’ model can be problematic because term independence causes the relationships between synonymous and related terms and the contextual influences that determine the ‘sense’ of polysemous terms to be ignored. This paper compares two methods that potentially address these problems by modelling the higher-order relationships that lie latent within the original vector space. The first is latent semantic analysis (LSA), a dimension reduction method which is a well known means of addressing the vocabulary mismatch problem in information retrieval systems. The second is the lesser known, yet conceptually simple approach of second-order similarity (SOS) analysis, where similarity is measured in terms of profiles of first-order similarities as computed directly from the term-document space. Nearest neighbour tests show that SOS analysis produces similarity models that are consistently better than both first-order and LSA derived models at resolving both coarse and fine level semantic clusters. SOS analysis has been criticised for its cubic complexity. A second contribution is the novel application of vector truncation to reduce the run-time by a constant factor. Speed-ups of four to ten times are found to be easily achievable without losing the structural benefits associated with SOS analysis
Open access and Scopus: a new approach to scientific visibility from the standpoint of access

Miguel, S., Chinchilla-Rodríguez, Z., Moya-Anegón, F.\ud
Open Access and Scopus: A New Approach to Scientific Visibility from the Standpoint of Access. Journal of the American Society for Information Science and Technology, 62 (6): 1130-1145, 2011. DOI: 10.1002/asi.21532The last few years have seen the emergence of several Open Access (OA) options in scholarly communication, which can broadly be grouped into two areas referred to as gold and green roads. Several recent studies showed how big the extent of OA is, but there have been few studies showing impact of OA in the visibility of journals covering all scientific fields and geographical regions. This research shows the extent of OA from the perspective of the journals indexed in Scopus, as well as influence on visibility, in view of the various geographic and thematic distributions. The results show that in all the disciplinary groups the presence of green road journals widely surpasses the percentage of gold road publications. The peripheral and emerging regions have greater proportions of gold road journals. These journals pertain for the\ud
most part to the last quartile. The benefits of open access on visibility of the journals are to be found on the green route, but paradoxically this advantage is not lent by the OA per se, but rather of the quality of the articles/journals themselves, regardless of their mode of access.Peer reviewe
The effect of task type on preferred element types in an XML‐based retrieval system

This article examines the influence of task type on the users' preferred level of document elements (full articles, sections, or subsections) during interaction with an XML-version of Wikipedia. We found that in general articles and subsections seemed to be the most valuable elements for our test subjects. For information-gathering tasks, this tendency was stronger, whereas for fact-finding tasks, the sections seemed to play a more important role. We assume from this that users select different information search strategies for the two task types. When dealing with fact-finding tasks, users seem more likely to use one single element as an answer, while when they do information gathering, they pick information from several elements
Study and correlation analysis of linguistic, perceptual and automatic machine translation evaluations

Evaluation of machine translation output is an important task. Various human evaluation techniques as well as automatic metrics have been proposed and investigated in the last decade. However, very few evaluation methods take the linguistic aspect into account. In this article, we use an objective evaluation method for machine translation output that classifies all translation errors into one of the five following linguistic levels: orthographic, morphological, lexical, semantic, and syntactic. Linguistic guidelines for the target language are required, and human evaluators use them in to classify the output errors. The experiments are performed on English-to-Catalan and Spanish-to-Catalan translation outputs generated by four different systems: 2 rule-based and 2 statistical. All translations are evaluated using the 3 following methods: a standard human perceptual evaluation method, several widely used automatic metrics, and the human linguistic evaluation. Pearson and Spearman correlation coefficients between the linguistic, perceptual, and automatic results are then calculated, showing that the semantic level correlates significantly with both perceptual evaluation and automatic metrics.Postprint (author's final draft
Citation Flows in the Zones of Influence of Scientific Collaborations

Domestic citation to papers from the same country and the greater citation impact of documents involving international\ud
collaboration are two phenomena that have been extensively studied and contrasted. Here, however, we showthat it is not somuch a national bias,but that papers have a greater impact on their immediate environments, an impact that is diluted as that environment grows. For this reason, the greatest biases are observed in countries\ud
with a limited production. Papers that involve international collaboration have a greater impact in general, on the one hand, because they have multiple “immediate\ud
environments,” and on the other because of their greater quality or prestige. In short, one can say that science knows no frontiers. Certainly there is a greater impact on the authors’ immediate environment, but this does not necessarily have to coincide with their national environments, which fade in importance as the collaborative environment expands.This work was financed by the Junta de Extremadura,Consejería de Educación, Ciencia & Tecnología and the Fondo Social Europeo as part of the pre-doctoral studentship\ud
PRE07052 and the research group grant GR10019, and by the Plan Nacional de Investigación Científica, Desarrollo e\ud
Innovación Tecnológica 2008-2011 and the Fondo Europeo de Desarrollo Regional (FEDER) as part of research projects TIN2008-06514-C02-01 and TIN2008-06514-C0202.Peer reviewe
Multiplicative and fractional strategies when journals are assigned to several subfields

In many data sets, articles are classified into subfields through the journals in which they have been published. The problem is that while many journals are assigned to a single subfield, many others are assigned to several. This article discusses a multiplicative and a fractional strategy to deal with this situation. The empirical part studies different aspects of citation distributions under the two strategies, namely: the number of articles, the mean citation rate, the broad shape of the distribution, their characterization in terms of size- and scale-invariant indicators of high and low impact, and the presence of extreme distributions, that is, distributions that behave very differently from the rest. We found that, despite large differences in the number of articles according to both strategies, the similarity of the citation characteristics of articles published in journals assigned to one or several subfields guarantees that choosing one of the two strategies may not lead to a radically different picture in practical applications. Nevertheless, the characterization of citation excellence through a high-impact indicator may considerably differ depending on that choiceWe acknowledge financial support by Santander Universities Global Division of Banco Santander. Ruiz-Castillo acknowledges financial support from the Spanish MEC through grant SEJ2007-67436Publicad
The French Conception of Information science. "Une exception française"?

International audienceThe French conception of Information science is often contrasted to the Anglophone one, which is perceived as different and rooted mainly in Shannon's mathematical theory of communication. While there is such thing as a French conception of information science, this conception is not totally divorced from the Anglophone one. Unbeknownst to researchers from the two geographical and cultural regions, they share similar conceptions of the field and invoke similar theoretical foundations, in particular the socio-constructivist theory. There is also a convergence of viewpoints on the dual nature of information science, i.e., the fact that it is torn between two competing paradigms - objectivist and subjectivist. Technology is another area where a convergence of viewpoints is noticeable: scholars from both geographic and cultural zones display the same suspicion towards the role of technology and of computer science. It would therefore be misleading to uphold the view that Anglophone information science is essentially objectivist and technicist while the French conception is essentially social and rooted in the humanities. This paper highlights converging analyses from authors based in both linguistic and geographical regions with the aim to foster a better understanding of the challenges that information science is facing worldwide and to help trace a path to how the global information science community can try to meet them
Learning a concept-based document similarity measure

Document similarity measures are crucial components of many text-analysis tasks, including information retrieval, document classification, and document clustering. Conventional measures are brittle: They estimate the surface overlap between documents based on the words they mention and ignore deeper semantic connections. We propose a new measure that assesses similarity at both the lexical and semantic levels, and learns from human judgments how to combine them by using machine-learning techniques. Experiments show that the new measure produces values for documents that are more consistent with people's judgments than people are with each other. We also use it to classify and cluster large document sets covering different genres and topics, and find that it improves both classification and clustering performance
Can Intermediary-based Science Standards Crosswalking Work? Some Evidence from Mining the Standard Alignment Tool (SAT)

This is the author's peer-reviewed final manuscript, as accepted by the publisher. The published article is copyrighted by the American Society for Information Science and Technology and is published by John Wiley & Sons, Inc. The published article can be found at: http://onlinelibrary.wiley.com/journal/10.1002/%28ISSN%291532-2890.We explore the feasibility of intermediary-based crosswalking and alignment of K-12 science education standards. With the increasing availability of K-12 science, technology, engineering, and mathematics (STEM) digital library content, alignment of that content with educational standards is a significant and continuous challenge. Whereas direct, one-to-one alignment of standards is preferable but currently unsustainable in its resource demands, less resource-intensive intermediary-based alignment offers an interesting alternative. But will it work? We present the results from an experiment in which the machine-based Standard Alignment Tool (SAT)—incorporated in the National Science Digital Library (NSDL)—was used to collect over half a million direct alignments between standards from different standard-authoring bodies. These were then used to compute intermediary-based alignments derived from the well-known AAAS Project 2061 Benchmarks and NSES standards. The results show strong variation among authoring bodies in their success at crosswalking, with the best results for those who modeled their standards on the intermediaries. The results furthermore show a strong inverse relationship between recall and precision when both intermediates were involved in the crosswalking
Ethical perspective on political-economic issues in the long-term preservation of digital heritage

The article provides an overview of the main ethical and
associated political-economic aspects of the preservation
of born-digital content and the digitization of analogue
content for purposes of preservation. The term
“heritage” is used broadly to include scientific and scholarly
publications and data. Although the preservation of
heritage is generally seen as inherently “good,” this
activity implies the exercise of difficult moral choices.
The ethical complexity of the preservation of digital heritage
is illustrated by means of two hypothetical cases.
The first deals with the harvesting and preservation in a
wealthy country of political websites originating in a less
affluent country. The second deals with a project initiated
by a wealthy country to digitize the cultural heritage of a
less affluent country. The ethical reflection that follows is
structured within the framework of social justice and a set
of information rights that are identified as corollaries of
generally recognized human rights. The main moral
agents, that is, the parties that have an interest, and may
be entitled to exercise rights, in relation to digital preservation,
are identified. The responsibilities that those who
preserve digital content have toward these parties, and
the political-economic considerations that arise, are then
analyzed.This article is an expanded version of a keynote paper
presented at the UNESCO Information for All Programme
(UNESCO/IFAP) International Conference on the Preservation
of Digital Information in the Information Society,
Moscow, October 3–5, 2011.http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)1532-289
Deriving query suggestions for site search

Modern search engines have been moving away from simplistic interfaces that aimed at satisfying a user's need with a single-shot query. Interactive features are now integral parts of web search engines. However, generating good query modification suggestions remains a challenging issue. Query log analysis is one of the major strands of work in this direction. Although much research has been performed on query logs collected on the web as a whole, query log analysis to enhance search on smaller and more focused collections has attracted less attention, despite its increasing practical importance. In this article, we report on a systematic study of different query modification methods applied to a substantial query log collected on a local website that already uses an interactive search engine. We conducted experiments in which we asked users to assess the relevance of potential query modification suggestions that have been constructed using a range of log analysis methods and different baseline approaches. The experimental results demonstrate the usefulness of log analysis to extract query modification suggestions. Furthermore, our experiments demonstrate that a more fine-grained approach than grouping search requests into sessions allows for extraction of better refinement terms from query log files. © 2013 ASIS&T
You Scratch Someone’s Back and We’ll Scratch Yours: Collective Reciprocity in Social Q&A Communities

Taking a structuration perspective while integrating reciprocity research in economics, this study examines the dynamics of reciprocal interactions in social Q&A communities. We postulate that individual users of social Q&A constantly adjust their kindness into the direction of the observed benefit and effort of others. Collective reciprocity emerges from this pattern of conditional strategy of reciprocation and helps form a structure that guides the very interactions that give birth to the structure. Based on a large sample of data from Yahoo! Answers, our empirical analysis supports the collective reciprocity premise, showing that the more effort (relative to benefit) an asker contributes to the community, the more likely the community will return the favor. On the other hand, the more benefit (relative to effort) the asker takes from the community, the less likely the community will cooperate in terms of providing answers. We conclude that a structuration view of reciprocity sheds light on the duality of social norms in online communities
Reliability and validity of query intent assessments

In most intent recognition studies, annotations of query intent are created post hoc by external assessors who are not the searchers themselves. It is important for the field to get a better understanding of the quality of this process as an approximation for determining the searcher's actual intent. Some studies have investigated the reliability of the query intent annotation process by measuring the interassessor agreement. However, these studies did not measure the validity of the judgments, that is, to what extent the annotations match the searcher's actual intent. In this study, we asked both the searchers themselves and external assessors to classify queries using the same intent classification scheme. We show that of the seven dimensions in our intent classification scheme, four can reliably be used for query annotation. Of these four, only the annotations on the topic and spatial sensitivity dimension are valid when compared with the searcher's annotations. The difference between the interassessor agreement and the assessor-searcher agreement was significant on all dimensions, showing that the agreement between external assessors is not a good estimator of the validity of the intent classifications. Therefore, we encourage the research community to consider using query intent classifications by the searchers themselves as test data