## 3 Materials and Methods
### Applying the AHP Method to Prioritize Quality Indicators in Scientific Documents  
The implementation of the multi-criteria decision technique Analytic Hierarchy Process [40] was carried out since it adjusts to a great extent to the requirements of the problem posed (establish a quality value for a scientific document). The method looks for weighting and prioritizing quality metrics, considering a quantitative and qualitative approach, which allows transforming multi-criteria decision problems into simple hierarchical structures to evaluate the different alternatives of criteria. The first level is the highest, where the goal is located, the following levels represent the general objectives and criteria that affect the problem, and the lower levels represent the alternatives to be evaluated [41]. The relevance of the AHP method lies in the assignment of relative weights to establish a ranking or qualification of each of the alternatives. For this purpose, pairwise comparison matrices are used to find the priority vectors, with the elements of these vectors commonly presented as constant values [42]. The method was carried out following the following steps:  
1. Definitions of the indicators and metrics that allow us to evaluate the quality of the document and thus improve its retrieval; they were grouped into three areas: Accessibility reflects how easy it is to locate and access information resources for the creation of knowledge. According to [43], it is necessary to implement metrics and indicators that measure the practices of open access to publications and data, and to re-evaluate research that produces positive and tangible benefits for society. In the context of this article, accessibility can be understood as the aspect of content from a machine's perspective, meaning that the content should be machine-processable for the purpose of indexing and retrieval. On the other hand, publishers have determined the way to access scientific publications according to their policies, thus having hybrid models that combine articles accessible by subscription or pay-per-publication; pay-per-publication models in which the articles are all open access funded by the author or sponsoring entity; and finally, open access without payment per publication. In a study carried out by the authors of [44], they state that full open access journals are more accessed than fee-paying ones. The content addresses the structuring and presentation of information, emphasizing how text, tables, images, and equations are displayed to facilitate their comprehension and processing by machines. In this sense, the paper must be easy to understand and must be organized clearly and succinctly, without lexical and grammatical errors. However, it is important to take into account readability, which measures the complexity and difficulty of the text, linguistic quality, semantic complexity, and fluency [45], and there are currently very few techniques to evaluate the quality of the machine's processable content. Reproducibility: At the data level, elements were identified that can be retrievable and, in some cases, executable or at least have access and availability for reuse. The researcher needs to be clear about the conditions of use from the legal point of view, for which a standard machine's readable license must be available. 2. Building the hierarchical model of quality indicators and metrics to be machine-processable. As shown in Figure 1, two hierarchical levels have been identified: the first (red) corresponds to the scopes defined in the previous step that cover the quality indexes and the second level (green) corresponds to each of the sub-scopes (nine in total) into which the scopes of the first level are divided to classify each of the previously defined indicators. The AHP method allows us to group the different indicators to facilitate and to measure the influence on the general objectives.