# Attributes-Based Decision Making for Selection of Requirement Elicitation Techniques Using the Analytic Network Process

Authors: Jinyu Li; Asif Ullah; Jun Li; Shah Nazir; Habib Ullah Khan; Hanif Ur Rehman; Amin Ul Haq
Journal: Mathematical Problems in Engineering
 (2020)

---

## Abstract

Requirement engineering is the first phase of software engineering. In requirement engineering, the first phase is requirement elicitation (RE), which is the most critical and error-prone activity. In this phase, the requirements are extracted from various sources; after extraction, they are analyzed and documented for a specific purpose of software development. In RE, process requirements from stakeholders are gathered, upon which the entire software product failure and success are dependent. In order to accomplish the goal of requirement elicitation, various techniques are used. However, the selection of these techniques is a very challenging task, as one technique may suit a situation but may not be suited for other situations. Besides this, project attributes such as documentation culture of organization, degree of relationship among stakeholders, and familiarity to domain also have a great impact on the process of technique selection. The reason is that there is no empirical value of the techniques that provide help in techniques selection to analyze the basis software project attributes. This study proposed the analytic network process, which is one of the multicriteria decision making processes for the elicitation technique selection process with respect to criterion attributes of project. The motivation toward the use of the ANP approach for the selection of requirement selection technique is that there are dependencies existing among attributes of the project elements. So, the ANP approach is capable of dealing with such situations where dependencies and complexity occur. Results of the proposed study demonstrate that the technique helps in complex situations where decision making is difficult based on the alternatives.


---

## Body

## 1. Introduction

The most important phase in developing software is requirement engineering, which combines different tasks of the developing system in order to gather requirements, taking into account the requirements of multiple stakeholders who have variations. RE is a complicated, practical, social, and intellectual process, which produces the software system requirements [1, 2]. Requirement gathering is known as the most complicated process and requires a lot of skills for the software development [3]. Instead of this, inappropriate requirement elicitation leads the software development process to failure and late product delivery. The main objective of the elicitation technique(s), used to elicit requirements, is to discover many possible issues in the process requirement gathering, which, in turn, facilitates obtaining appropriate software product for stakeholders, which can fulfill their requirements [4]. In industry, different techniques are used to collect most adequate requirements of a specific software project. However, the most suitable technique selection requires in-depth knowledge of the problem domain, techniques available, and requirement sources (domain experts, organization, market, users, and customers) from where requirement collection is carried out. However, there does not exist one single elicitation technique that works best to solve all kinds of problems. Therefore, techniques used for requirement elicitation are categorized into four various types: cognitive techniques, group techniques, traditional techniques, and contextual techniques [5]. Similarly, lack of knowledge regarding attributes, the most appropriate technique selection, is a challenging task for a particular software. There exist a lot of elicitation techniques for requirement gathering, but among them, some techniques are appropriate to use in some specific condition, while others are not that much suitable to use. [6]. In the same way, there is a need of a technique through which one might be able to elicit the most appropriate requirements for a specific problem based on some attributes. The other techniques work for different situations; however, no such technique is available, which best fits in situation when there is complexity and the decision is based on attributes.This research first identifies software project attributes. Then, ANP method is used, which is a multicriteria decision making (MCDM) approach. ANP is used for the elicitation technique selection on the basis of project attributes specified. The ANP method provides a model that is used to determine the comparative importance of the software project attributes selected and how a particular technique could be applied with respect to each attribute. It can improve the chances of dependable results, and requirement engineers can help in the process of techniques selection in order to gather requirements. The ANP works well where there are dependencies, and feedback is needed among the elements of the network. The proposed research main contributions are as follows:(i)
To identify the software project attributes for requirement elicitation technique(ii)
To identify the relative significance of the attributes with respect to the project(iii)
To use multicriteria decision making approach for the selection of requirement elicitation techniqueThis research work will help the analyst in decision making with full comprehension of both upside and downside (trade-off analysis) of techniques regarding attributes. This research provides a base that will certainly help requirement engineers in the selection of appropriate technique.The paper organization is given as follows: Section2 presents related work. Section 3 presents the methodology of ANP for the conduction of the proposed research, attributes for technique selection and elicitation techniques, expert opinion for weights derivation, and experimental work. Section 4 presents results and discussion. Section 5 contains the conclusion of the paper.


## 2. Related Work

Several approaches are adopted by researchers for elicitation techniques used in industry and stated in literature. The applicability of these approaches is dependent on the requirement types gathered, the environment of the project, and features of the target technique. There are limited guidelines for requirement engineers to support them in the selection of most appropriate technique to gather proper requirements. It has been evidenced from the literature that criteria for the assessment and comparing related work are based on disciplines in which proposal is applicable, scope which the proposal intends to achieve, information type upon which proposal is based, number of elicitation techniques covered, kinds of elicitation process contextual elements accounted for, specification of the contextual attribute values, and evolving ability of the proposal. The elicitation session preparation involves understanding of the domain of application by elaborating policy, organizational and social aspects, and system development constraints, identification of requirement sources, stakeholder analysis, technique selection, tools used for requirements, and requirement elicitation from users [6]. In actual practice, when a particular software system’s analysts start gathering requirements, they usually use one technique only, which is interview, for information gathering; besides that, analysts are possibly familiar with numerous techniques [7]. People are using different techniques taken from other disciplines like linguistics, sociology, anthropology, and cognitive psychology [8], and techniques used by knowledge engineering [9], and now software engineering. Most of the software developers are not aware of these techniques for optimization of their elicited requirements. This is thought out to be a breach between practice and theory [10].Most of the researchers tried their best to propose techniques for optimization of the selection process [3, 11–13]. But, still, the existing efforts do not provide any empirical exploration and complete assessment regarding relative significance of various selection issues and their supporting strength for each and every technique. Researchers such as Ghanbar et al. [14] introduced an approach of eliciting requirements. In this approach, online serious games are applied for gathering requirements in situations, in which stakeholders of software systems are dispersed. By using empirical evaluation, the effectiveness and validity of the approached were checked and hence, much more encouraging results are produced. Burnay et al. [15] proposed a method of “Elicitation Topic Map” (ETM) to facilitate analysts to prepare interviews. Ribeiro et al. [16] presented an approach in order to verify the acceptance and effectiveness of a tool that is web collaborative, whose main purpose is stakeholders gathering in order to gather requirements. The tool development approach is Six Thinking Hats Method and gamification. The main aim of this work is to improve stakeholder’s collaboration by discussing results and implications. Ruf et al. [17] reported the elicitation of Mobile Financial Advisory Service (mFAS) requirements for the purpose of its design by validating and instantiating the Requirement Data Model (RDMod). A selection of multimethod approach is done for attaining this goal, focus groups and the review of literature.Yousaf and Asger [5] provided different elicitation techniques comparison for requirements. They introduced top to bottom survey of various techniques, their strengths, and weaknesses. Chakraborty et al. [18] proposed technique for the process of eliciting requirements based on conceptualized approach, which emphasizes dynamics of interactions between requirement engineer and future system user. The multifaceted, collaborative perspective of requirement elicitation is repeated by them, and guidelines that are well enough to explain this collaboration are provided. This collaborative activity success depends upon group ability in building up a share frame of reference and furthermore, to work collectively. Most of the empirical research studies are conducted in recent years. However, most of the empirical researches conducted are dependent on experiments in laboratory in which students mainly focus on techniques effects of requirement elicitation on the final product of elicitation process. [19]. The authors [20] define a Methodology for Requirement Engineering Techniques Selection (MRETS); requirement engineering is facilitated by this approach to choose adequate technique for a particular project with respect to requirements. The MRETS proceeds towards the selection of techniques from the given three perspectives as follows: (1) A connection setup between attributes of both techniques and projects. (2) Based on evaluation schema, detailed analysis is carried out by using clustering. (3) Useful tools have been provided by the objective function to select RE techniques. The process of RE is of multidisciplinary nature; in a specific situation, a technique could be perfect, but it may not in another. Table 1 shows the summary of the techniques and approaches used.Table 1
Techniques and approaches used for requirement elicitation.
ReferenceTechniqueDescription[6]Survey of requirement elicitation techniques, approaches, and toolsSignificant aspects of tools, techniques, and approaches are covered along with the trends, issues, and challenges in the field[8]Roadmap of requirement engineeringThis research work provides an overview about requirement engineering (RE) of the software systems. It defines the core areas of RE practice and points out some main issues of open research for the future.[9]Techniques of knowledge elicitationThe main reason of this survey is (1) knowledge elicitation techniques identification and the related bibliographic information, (2) techniques organization into categories based on methodological resemblance, and (3) summarizing techniques strengths, weaknesses, and suggested applications.[10]Elicitation technique selection: how do experts do it?This study provides in-depth interviews results conducted from some of the world’s most experienced analysts. The results produced show how the selection is carried out for elicitation techniques based on a variety of situational assessments.[11]Framework for matching requirement engineering techniquesThis paper proposed a framework in which the typical requirement engineering techniques are characterized, which in turn provides a base for the selection of most adequate techniques at the time when the project starts and at the time of identifying a change in nature of the project or experiencing difficulties in describing a appropriate set of requirements.[12]Framework for selection of requirement elicitation techniquesIn this paper, a framework is introduced; this framework helps analysts select the most suitable elicitation technique that is fit for the elicitation session, the project environment, and problem domain. After applying this framework, it provides a priority list of elicitation techniques that best suits the project.[14]Utilizing online serious games to facilitate distributed requirement elicitationThis paper proposed a new approach, i.e., online serious games, in order to gather requirements from the stakeholders distributed. Empirical study was conducted in this approach to evaluate the feasibility and find the effectiveness. The results produced by this approach were good enough and helped out less experienced analysts gather higher number of requirements. The results produced also recognized that this approach provides simple and easy way to individuals that are technically less experienced and allows them to contribute in requirement elicitation.[15]A theoretical and empirical study of topic importance in requirement engineering elicitation interviewsThis study proposed the elicitation topic map (ETM), which helps engineers formulate interviews. ETM shows topics in the form of diagrams; these diagrams are then discussed in interviews and represents how likely to discuss these topics spontaneously by the stakeholders. If a topic to be discussed spontaneously, it is less likely, then suggestions to engineers are that they might wish to make questions on it just before the interview. ETM was shaped through empirical and theoretical research.[16]Gamifying requirement elicitationThis study examines that how much web collaborative tools are useful and accepted, in which development was done by using approach of the six thinking hats method and gamification to get dispersed stakeholders altogether. The document discusses the implication and results in order to improve collaboration among stakeholders.[21]Requirement elicitation techniques selectionThe study was conducted in knowledge-based systems based on previous works, evaluating and building upon their efforts, and extended the knowledge-based approach by considering taxonomy of project characteristics. It has mainly bridged the gap to provide necessary support for the analyst by taxonomy of the software project types. The method proposed provides support in terms of selection of appropriate elicitation technique and knowledge base related to it. The method evaluation is done through a case study and prototype to check its effectiveness and feasibility.[22]Review of techniques of requirement elicitationThis paper presented elicitation techniques understanding and how to use them in applications of real time. The implementation of these techniques of requirement gathering provides base to know clearly requirements of the stakeholders and also helps developers better understand the requirements of the developing system.[23]Requirement elicitation problemsThis paper presented problem types classification that requirement elicitation process faces. To derive this classification, a literature analysis has been carried out. Papers reporting on techniques for improving requirement elicitation practice were examined for the problem the technique was designed to address. The classification contains the most prominent or recent techniques for solving the problems. The requirement engineer is allowed by the classification to be sensitive on the rise of the problems and the educator to structure delivery of requirement elicitation training.[24]Assessment of requirement elicitation tools and techniquesThis paper provides the understanding of requirement elicitation tools and techniques. The paper also presented the comparison of elicitation techniques and software requirement tools in a summarized form, and this comparison is based on different parameters.[25]Requirement elicitation frameworkThis study proposed a framework of requirement elicitation, which starts with an organization’s business process model and builds the system’s CRUD matrix. This matrix actually provides all possible relationships between entities and functions of the system in order to gather complete requirements of the system.[26]Analysis of elicitation techniques for design of smart requirementsThis paper presented elicitation techniques comparison in detail, along with its characteristics as well as situational characteristics. The main aim of comparative analysis is to support analyst for selection of suitable requirement elicitation technique on the basis of different situational characteristics. The model presented will be quite helpful to automate the process of technique selection for elicitation.[18]An exploration into the process of requirement elicitationIn this study for RE, an integrative process model is presented. The suggestion comes from the study’s finding that there are four collaborative states from which RE is composed. This research explains these four states, and important factors are identified, which tend to trigger transitions from one state to another.[19]Review and aggregation of empirical studies on elicitation techniquesThis research has provided empirical studies results on the techniques used for elicitation, and empirical evidence has been provided after the results aggregated. The methodology chosen for surveying was systematic review, whereas comparative analysis method is adopted for aggregation because the applicability of meta-analysis techniques is not possible. In review, identification of 564 publications is done from ACM DL databases, IE EEXPLORE, SCOPUS, and Google. In this research, 26 publications are selected, and then data is extracted from them. The 30 empirical studies are found in the selected publications. These studies were designed to test 43 elicitation techniques and 50 different response variables. The study got 100 separate results from the experiments. The 17 pieces of knowledge are generated by the aggregation about sorting, laddering, protocol analysis, and interviewing elicitation techniques. In this research, the gathered knowledge provides guidelines set.


## 3. ANP Approach for the Selection of Elicitation Technique

Multicriteria decision support system (MCDSS) is used to facilitate the issues arise from daily life. Due to the usefulness of multicriteria based decision support system, researchers are trying to devise machine learning algorithms to provide an intelligent decision making alternative [27–29]. Decision support systems (DSS) are used in a variety of applications and domains for solving or assisting the decision maker to take a more appropriate decision, and these can be exploited in almost all domains to solve decision problems, such as DSS in Agriculture [30], energy sector [31], waste management, and business [32], [33]. These DSS can help practitioners solve the particular problems in the area domain of real life. Various domains exploit the theories and methods of decision making alternatives from simple to more advanced and intelligent models [34, 35]. DSS is an active area of research where research finds new ways to evaluate multiple criteria and propose intelligent framework for enhancing the potential of decision support systems.ANP is a MCDM method, which is used to handle the problems when it becomes very difficult to make a decision. In the ANP, the elements are clustered with each other in a group of networks. The cluster consists of different elements and nodes connected to each other via a network. The ANP works well where there are dependencies, and feedback is needed among the elements of the network. The ANP is a suitable tool to handle such a complicated situation. The following sections briefly show the details of the ANP process for the proposed research.


### 3.1. Analytic Network Process

The main goal of ANP method is to handle the selection of elicitation technique, both inner and outer dependencies among the project environment attributes of the network of nodes. ANP is applicable in different situations such as [36]. The ANP deals in situations when there is complexity among the available alternatives based on some criteria, and the selection is uncertain. No decision is possible on which option should be adopted. So, to overcome such situation, the ANP is the best option to be adopted. The summarized form of the main steps involved in ANP method is given as follows [37]:(i)
The network is composed of various clusters.(ii)
A cluster is a combination of nodes.(iii)
Weighting scale is relative to the importance of each node within the cluster.(iv)
Set up a matrix [A] of n × n.(v)
Pairwise comparison is computed among nodes.(vi)
Sum the columns of the matrix [A].(vii)
Normalize the matrix [A] by dividing the elements in each column by the sum value of that column obtained in original matrix [A]. After normalizing the matrix, [A] averages the rows to get the Eigenvector [24].(viii)
To check the consistency, determine a weight sum vector, i.e., {Ws} = [C]{W}.(ix)
Consistency vector will be obtained by computing dot product of {Ws} and {1/W}, i.e., {Consis} = {Ws}. {1/W}.(x)
Determine the average of the elements of {Consis} to getλmax(xi)
Find consistency index and consistency ratio by(1)CI=λmax−nn−1,where n is the number of elements in a matrix by(2)CR=CIRI,where RI is a random index.Table2 shows the RI presented by Saaty [38].Table 2
Random consistency index.
Number of elements (N)Random consistency index (RI)102030.5840.951.1261.2471.3281.4191.45101.49111.51121.48131.56141.57151.59CR value should always be smaller than 0.1; else, the process of calculating the CR should be revised so that the value becomes less than 0.1:(i)
The combination of Eigenvectors of the matrices will provide super matrix. Unweighted super matrix is a matrix if the value obtained from column sum is bigger than one. In order to obtain the value of sum of the column less than or equal to one, unweighted super matrix will be normalized.(ii)
The weighted matrix will be obtained after normalizing unweighted matrix.(iii)
Furthermore, the transformation of super matrix into limit matrix will be carried out.(iv)
The limit matrix obtained provides help to select the most appropriate alternative.The steps involved in ANP technique along with the process of calculations are shown in Figure1.Figure 1
Steps of the process of the ANP.


### 3.2. Attributes for Technique Selection and Elicitation Techniques

Project environment attributes greatly affect technique selection for elicitation process. A technique for elicitation may be fit for an attribute but may be not for the rest. E.g:- if stakeholders are easily available, then interview is a good technique that can be applied, but if the analysts find them hard to be available, then he/she cannot use this technique. Industry practices, interviews conducted from domain experts, and large amount of literature reviews have been observed for the identification of attributes of software project environment that are highly influential on the technique selection process [38–40]. These attributes are given as follows:(1)
Availability of Key Stakeholders (ASTK)(2)
Availability of Reusable Requirements (RQ)(3)
Computer Literacy (CL)(4)
Degree of Financial Constraints (FCO)(5)
Degree of Project Schedule Constraints (SCO)(6)
Degree of Relationship among Stakeholders (RSTK)(7)
Diversity of Stakeholders (DSSK)(8)
Documentation Culture of Organization (DOC)(9)
Familiarity to Domain (FD)(10)
Interactive Nature of Prospective System (INT)(11)
Maintenance of Existing System (MES)(12)
People per Session (PS)(13)
Relation between Analyst and Client (RAC)(14)
User’s Expressiveness (EXP)Requirement elicitation is collaborative and human oriented activity where knowledge from other fields is also used widely such as management science, psychology, and sociology. The most crucial task for a requirement engineer in the process of developing software is a suitable technique selection. In process of requirement gathering, various techniques are used to elicit requirements. But there is no such technique that works well to cover all the aspects of the software project. The literature [5, 24, 26] and industry report many techniques that are used for requirement gathering. But this research mainly focuses on techniques that are most widely used such as (i) Document Analysis (DA), (ii) Interview (IV), (iii) Introspection (IS), (iv) Questionnaire (QN), (v) Survey (SV), and (vi) Task Analysis (TA).In this study, the process of technique selection to gather requirements is based on attributes of the software project environment. ANP comprises three key components, i.e., (1) Goal, (2) Criteria, and (3) Alternatives. The algorithm presented Saaty’s scale, which actually describes the fundamental scales for the judgements and represents the importance of elements among themselves. Table3 also shows the importance of one element from the other.Table 3
Saaty’s scale of judgment for the elements.
DefinitionExplanationIntensity of valuesEqual importanceTwo factors contribute equally to the objective.1Somewhat more importantExperience and judgment slightly favor one over the other.3Much more importantExperience and judgment strongly favor one over the other.5Very much more importantExperience and judgment very strongly favor one over the other. Its importance is demonstrated in practice.7Absolutely more importantThe evidence favoring one over the other is of the highest possible validity.9Intermediate valuesWhen compromise is needed.2,4,6,8Figure2 represents techniques and attributes using ANP.Figure 2
Representation of techniques and attributes using the ANP.


### 3.3. Derivation of Weights from Expert’s Opinion

In this study, ANP method is applied to the proposed model by in which comparisons are carried out in two phases. These comparisons are performed in such way that first attributes comparisons are done among themselves with respect to techniques and then comparisons among techniques with respect to attributes. Domain experts (Employee) of various software houses are the source from where data are collected. Questionnaire was used as a data collection tool, distributed among 25 experts. At the start, domain experts were first briefed about techniques used for requirement elicitation and project attributes. After the discussions, the experts came with the idea of using these techniques that are mostly used for requirement gathering and software development. Questions related to the techniques and their attributes were given to the experts. These questions have covered all techniques mentioned along with the attributes for facilitating requirement gathering. The experts assigned weights to attributes of project environment and to techniques used for elicitation that lead to a balanced agreement on each attribute and technique with respect to weight. To eliminate the variations that occurred in the opinions extracted from experts, a normalized geometric mean on opinions of experts is applied. In this research, traditional techniques are considered, that is, Document Analysis (DA), Interview (IV), Questionnaire (QN), Introspection (IS), Survey (SV), and Task Analysis (TA). These techniques were chosen to validate results and they pushed into matrix ofn × n. The relative weights of the afore mentioned techniques are shown as Tij, where “i” is for the row’s representation in the matrix and “j” is for columns. If in the matrix relative weights assigned to any two techniques are the same, then the values of Tij = 1 and Tji = 1. Then in position where Tij is compared with the Tji which will definitely be a diagonal value, value “1” will be placed in that position. As shown in the given matrix below, “1” is inserted in DA11, IV22, IS33, QN44, SV55, and TA66:(3)DAIVISQNSVTADA1IV1IS1QN1SV1TA1.After deciding weights for different parameters, the step by step ANP method to select an elicitation technique with respect to Attributes of project environment is as follows. Techniques comparison with respect to attribute SCO is as given in Table4.Table 4
Techniques comparison with respect to attribute SCO.
DAIVISQNSVTADA10.22330.5IV515775IS0.50.210.50.50.33QN0.330.14210.50.33SV0.330.142210.33TA20.23331Total9.171.881516.50157.50The process of normalization of original matrix as shown in Table4 is carried out and is given in Table 5.Table 5
Original matrix normalization process.
DAIVISQNSVTADA1/9.17=0.110.2/1.88=0.112/15=0.133/16.5=0.183/15=0.200.5/7.50=0.07IV5/9.17=0.551/1.88=0.535/15=0.337/16.5=0.427/15=0.475/7.50=0.67IS0.5/9.17=0.050.2/1.88=0.111/15=0.070.5/16.5=0.030.5/15=0.030.33/7.50=0.04QN0.33/9.17=0.040.14/1.88=0.072/15=0.131/16.5=0.060.5/15=0.030.33/7.50=0.04SV0.33/9.17=0.040.14/1.88=0.072/15=0.132/16.5=0.121/15=0.070.33/7.50=0.04TA2/9.17=0.220.2/1.88=0.113/15=0.203/16.5=0.183/15=0.201/7.50=0.13Table6 is extracted as a result of Table 5 and is said to be a normalized table if we calculate the sum of all columns in Table 4 and the result obtained is equal to 1. Now, to calculate Eigenvalues, the procedure that followed is to find the row sum of Table 5 which will be then divided by the total numbers of column in Table 6. The consistency ratio (CR) is calculated by the formula given in equation (2).Table 6
Normalized matrix.
DAIVISQNSVTADA0.110.110.130.180.200.07IV0.550.530.330.420.470.67IS0.050.110.070.030.030.04QN0.040.070.130.060.030.04SV0.040.070.130.120.070.04TA0.220.110.200.180.200.13CR = 0.085.The same processes of comparisons have been done for the rest of the attributes.Comparison of attributes with respect to Interview is shown in Table7.Table 7
Comparison of attributes with respect to interview.
MESCLRQINTASTKFCOSCOFDRACEXPRSTKDSSKDOCPPSEVMES11/3331/31/31/21/31/31/31/23320.051CL31431/31/321/31/31/21/33330.069RQ1/31/4121/31/31/31/31/31/31/3321/20.035INT1/31/31/211/31/31/31/31/31/31/331/21/20.029ASTK333311/2231/231/33330.104FCO333321231/3323330.125SCO21/2331/21/211/21/21/21/33320.061FD33331/31/3211/331/33330.087RAC333323231224330.148EXP32331/31/321/31/211/33330.075RSTK233331/2331/2313330.122DSSK1/31/31/31/31/31/31/31/31/41/31/311/21/30.022DOC1/31/31/221/31/31/31/31/31/31/3211/30.030PPS1/21/3221/31/31/21/31/31/31/33310.042CR = 0.0939269.The same processes of comparisons have been done for the rest of the requirement elicitation techniques.


## 3.1. Analytic Network Process

The main goal of ANP method is to handle the selection of elicitation technique, both inner and outer dependencies among the project environment attributes of the network of nodes. ANP is applicable in different situations such as [36]. The ANP deals in situations when there is complexity among the available alternatives based on some criteria, and the selection is uncertain. No decision is possible on which option should be adopted. So, to overcome such situation, the ANP is the best option to be adopted. The summarized form of the main steps involved in ANP method is given as follows [37]:(i)
The network is composed of various clusters.(ii)
A cluster is a combination of nodes.(iii)
Weighting scale is relative to the importance of each node within the cluster.(iv)
Set up a matrix [A] of n × n.(v)
Pairwise comparison is computed among nodes.(vi)
Sum the columns of the matrix [A].(vii)
Normalize the matrix [A] by dividing the elements in each column by the sum value of that column obtained in original matrix [A]. After normalizing the matrix, [A] averages the rows to get the Eigenvector [24].(viii)
To check the consistency, determine a weight sum vector, i.e., {Ws} = [C]{W}.(ix)
Consistency vector will be obtained by computing dot product of {Ws} and {1/W}, i.e., {Consis} = {Ws}. {1/W}.(x)
Determine the average of the elements of {Consis} to getλmax(xi)
Find consistency index and consistency ratio by(1)CI=λmax−nn−1,where n is the number of elements in a matrix by(2)CR=CIRI,where RI is a random index.Table2 shows the RI presented by Saaty [38].Table 2
Random consistency index.
Number of elements (N)Random consistency index (RI)102030.5840.951.1261.2471.3281.4191.45101.49111.51121.48131.56141.57151.59CR value should always be smaller than 0.1; else, the process of calculating the CR should be revised so that the value becomes less than 0.1:(i)
The combination of Eigenvectors of the matrices will provide super matrix. Unweighted super matrix is a matrix if the value obtained from column sum is bigger than one. In order to obtain the value of sum of the column less than or equal to one, unweighted super matrix will be normalized.(ii)
The weighted matrix will be obtained after normalizing unweighted matrix.(iii)
Furthermore, the transformation of super matrix into limit matrix will be carried out.(iv)
The limit matrix obtained provides help to select the most appropriate alternative.The steps involved in ANP technique along with the process of calculations are shown in Figure1.Figure 1
Steps of the process of the ANP.


## 3.2. Attributes for Technique Selection and Elicitation Techniques

Project environment attributes greatly affect technique selection for elicitation process. A technique for elicitation may be fit for an attribute but may be not for the rest. E.g:- if stakeholders are easily available, then interview is a good technique that can be applied, but if the analysts find them hard to be available, then he/she cannot use this technique. Industry practices, interviews conducted from domain experts, and large amount of literature reviews have been observed for the identification of attributes of software project environment that are highly influential on the technique selection process [38–40]. These attributes are given as follows:(1)
Availability of Key Stakeholders (ASTK)(2)
Availability of Reusable Requirements (RQ)(3)
Computer Literacy (CL)(4)
Degree of Financial Constraints (FCO)(5)
Degree of Project Schedule Constraints (SCO)(6)
Degree of Relationship among Stakeholders (RSTK)(7)
Diversity of Stakeholders (DSSK)(8)
Documentation Culture of Organization (DOC)(9)
Familiarity to Domain (FD)(10)
Interactive Nature of Prospective System (INT)(11)
Maintenance of Existing System (MES)(12)
People per Session (PS)(13)
Relation between Analyst and Client (RAC)(14)
User’s Expressiveness (EXP)Requirement elicitation is collaborative and human oriented activity where knowledge from other fields is also used widely such as management science, psychology, and sociology. The most crucial task for a requirement engineer in the process of developing software is a suitable technique selection. In process of requirement gathering, various techniques are used to elicit requirements. But there is no such technique that works well to cover all the aspects of the software project. The literature [5, 24, 26] and industry report many techniques that are used for requirement gathering. But this research mainly focuses on techniques that are most widely used such as (i) Document Analysis (DA), (ii) Interview (IV), (iii) Introspection (IS), (iv) Questionnaire (QN), (v) Survey (SV), and (vi) Task Analysis (TA).In this study, the process of technique selection to gather requirements is based on attributes of the software project environment. ANP comprises three key components, i.e., (1) Goal, (2) Criteria, and (3) Alternatives. The algorithm presented Saaty’s scale, which actually describes the fundamental scales for the judgements and represents the importance of elements among themselves. Table3 also shows the importance of one element from the other.Table 3
Saaty’s scale of judgment for the elements.
DefinitionExplanationIntensity of valuesEqual importanceTwo factors contribute equally to the objective.1Somewhat more importantExperience and judgment slightly favor one over the other.3Much more importantExperience and judgment strongly favor one over the other.5Very much more importantExperience and judgment very strongly favor one over the other. Its importance is demonstrated in practice.7Absolutely more importantThe evidence favoring one over the other is of the highest possible validity.9Intermediate valuesWhen compromise is needed.2,4,6,8Figure2 represents techniques and attributes using ANP.Figure 2
Representation of techniques and attributes using the ANP.


## 3.3. Derivation of Weights from Expert’s Opinion

In this study, ANP method is applied to the proposed model by in which comparisons are carried out in two phases. These comparisons are performed in such way that first attributes comparisons are done among themselves with respect to techniques and then comparisons among techniques with respect to attributes. Domain experts (Employee) of various software houses are the source from where data are collected. Questionnaire was used as a data collection tool, distributed among 25 experts. At the start, domain experts were first briefed about techniques used for requirement elicitation and project attributes. After the discussions, the experts came with the idea of using these techniques that are mostly used for requirement gathering and software development. Questions related to the techniques and their attributes were given to the experts. These questions have covered all techniques mentioned along with the attributes for facilitating requirement gathering. The experts assigned weights to attributes of project environment and to techniques used for elicitation that lead to a balanced agreement on each attribute and technique with respect to weight. To eliminate the variations that occurred in the opinions extracted from experts, a normalized geometric mean on opinions of experts is applied. In this research, traditional techniques are considered, that is, Document Analysis (DA), Interview (IV), Questionnaire (QN), Introspection (IS), Survey (SV), and Task Analysis (TA). These techniques were chosen to validate results and they pushed into matrix ofn × n. The relative weights of the afore mentioned techniques are shown as Tij, where “i” is for the row’s representation in the matrix and “j” is for columns. If in the matrix relative weights assigned to any two techniques are the same, then the values of Tij = 1 and Tji = 1. Then in position where Tij is compared with the Tji which will definitely be a diagonal value, value “1” will be placed in that position. As shown in the given matrix below, “1” is inserted in DA11, IV22, IS33, QN44, SV55, and TA66:(3)DAIVISQNSVTADA1IV1IS1QN1SV1TA1.After deciding weights for different parameters, the step by step ANP method to select an elicitation technique with respect to Attributes of project environment is as follows. Techniques comparison with respect to attribute SCO is as given in Table4.Table 4
Techniques comparison with respect to attribute SCO.
DAIVISQNSVTADA10.22330.5IV515775IS0.50.210.50.50.33QN0.330.14210.50.33SV0.330.142210.33TA20.23331Total9.171.881516.50157.50The process of normalization of original matrix as shown in Table4 is carried out and is given in Table 5.Table 5
Original matrix normalization process.
DAIVISQNSVTADA1/9.17=0.110.2/1.88=0.112/15=0.133/16.5=0.183/15=0.200.5/7.50=0.07IV5/9.17=0.551/1.88=0.535/15=0.337/16.5=0.427/15=0.475/7.50=0.67IS0.5/9.17=0.050.2/1.88=0.111/15=0.070.5/16.5=0.030.5/15=0.030.33/7.50=0.04QN0.33/9.17=0.040.14/1.88=0.072/15=0.131/16.5=0.060.5/15=0.030.33/7.50=0.04SV0.33/9.17=0.040.14/1.88=0.072/15=0.132/16.5=0.121/15=0.070.33/7.50=0.04TA2/9.17=0.220.2/1.88=0.113/15=0.203/16.5=0.183/15=0.201/7.50=0.13Table6 is extracted as a result of Table 5 and is said to be a normalized table if we calculate the sum of all columns in Table 4 and the result obtained is equal to 1. Now, to calculate Eigenvalues, the procedure that followed is to find the row sum of Table 5 which will be then divided by the total numbers of column in Table 6. The consistency ratio (CR) is calculated by the formula given in equation (2).Table 6
Normalized matrix.
DAIVISQNSVTADA0.110.110.130.180.200.07IV0.550.530.330.420.470.67IS0.050.110.070.030.030.04QN0.040.070.130.060.030.04SV0.040.070.130.120.070.04TA0.220.110.200.180.200.13CR = 0.085.The same processes of comparisons have been done for the rest of the attributes.Comparison of attributes with respect to Interview is shown in Table7.Table 7
Comparison of attributes with respect to interview.
MESCLRQINTASTKFCOSCOFDRACEXPRSTKDSSKDOCPPSEVMES11/3331/31/31/21/31/31/31/23320.051CL31431/31/321/31/31/21/33330.069RQ1/31/4121/31/31/31/31/31/31/3321/20.035INT1/31/31/211/31/31/31/31/31/31/331/21/20.029ASTK333311/2231/231/33330.104FCO333321231/3323330.125SCO21/2331/21/211/21/21/21/33320.061FD33331/31/3211/331/33330.087RAC333323231224330.148EXP32331/31/321/31/211/33330.075RSTK233331/2331/2313330.122DSSK1/31/31/31/31/31/31/31/31/41/31/311/21/30.022DOC1/31/31/221/31/31/31/31/31/31/3211/30.030PPS1/21/3221/31/31/21/31/31/31/33310.042CR = 0.0939269.The same processes of comparisons have been done for the rest of the requirement elicitation techniques.


## 4. Results and Discussion

The proper requirement elicitation is one of the core issues in the software development process. To gather most appropriate requirements of the problem domain elicitation technique selection is also very important and difficult task. The reason is that an elicitation technique might be suitable for use in one situation which results in suitable requirement gathering but it may not be suitable to use in other situations. On the other hand, technique selection process is greatly affected by project attributes of the software system due to the reason that there is no observed value of the techniques to assist the analyst in the process of technique selection. The ANP method is applied which is of the MCDM approach for the appropriate selection of technique to elicit requirements on the basis of software project attributes. In this study, the first step that was taken is the development of a network structure. This network structure was designed in such way that it consists of goal, criteria, and alternatives associated with criteria. The proposed research, results, and discussion section are shown in the following sections:


### 4.1. Weighted Super Matrix

A weighted super matrix is a matrix in which total sum of all the columns must be equal to or less than “1”; otherwise the matrix will be normalized to get weighted matrix. Table8 shows weighted super matrix.Table 8
Weighted super matrix.
SCOMESRACRQRSTKDOCINTFCOFDASTKEXPCLDSSKPSIVSVQNTADAISSCO0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.060.030.070.090.120.09MES0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.050.050.100.110.070.08RAC0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.150.150.060.070.040.18RQ0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.040.100.050.100.100.04RSTK0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.120.100.040.070.040.14DOC0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.030.100.040.040.210.03INT0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.030.040.040.160.080.02FCO0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.130.030.030.040.060.03FD0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.090.090.120.140.120.11ASTK0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.100.080.140.050.040.09EXP0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.080.080.030.040.040.09CL0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.070.060.140.030.030.05DSSK0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.020.030.040.030.030.02PS0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.040.070.110.030.020.03IV0.490.240.360.150.200.150.160.370.220.340.350.400.140.430.000.000.000.000.000.00SV0.080.080.070.240.260.230.230.250.090.140.150.200.130.200.000.000.000.000.000.00QN0.060.060.050.080.050.110.120.170.100.120.120.160.360.140.000.000.000.000.000.00TA0.170.420.210.120.050.060.380.100.360.070.050.050.050.050.000.000.000.000.000.00DA0.130.150.170.370.050.400.070.070.160.050.060.070.240.070.000.000.000.000.000.00IS0.060.050.140.040.380.050.050.040.060.280.280.110.070.110.000.000.000.000.000.00


### 4.2. Limit Matrix

The values in the weighted super matrix are raised to the power until the rows in the weighted super matrix become the same and stable. The matrix obtained as a result of this process of the weighted super matrix is called the limit matrix. The limit matrix is the summarized form of all the pairwise comparison matrices. The limit matrix as shown in Table9 contains the priorities of all the elements which help the requirement engineer select a suitable technique with respect to project environment attributes.Table 9
Limit matrix.
SCOMESRACRQRSTKDOCINTFCOFDASTKEXPCLDSSKPSIVSVQNTADAISSCO0.06810.06890.06880.06890.06810.06880.06950.06880.06820.06880.06950.06810.06810.0688000000MES0.06550.06610.06610.06610.06550.06610.06680.06610.06550.06610.06680.06550.06540.066100000RAC0.10620.10730.10730.10730.10620.10730.10840.10730.10620.10730.10830.10620.10620.1073000000RQ0.06240.06300.06300.06300.06240.06300.06370.06300.06240.06300.06360.06240.06230.0630000000RSTK0.08540.08630.08620.08630.08540.08620.08710.08620.08540.08620.08710.08540.08530.0862000000DOC0.06480.06540.06540.06540.06480.06540.06610.06540.06480.06540.06600.06470.06470.0654000000INT0.05500.05560.05560.05560.05500.05560.05620.05560.05510.05560.05610.05500.05500.0556000000FCO0.05810.05870.05870.05870.05810.05870.05930.05870.05810.05870.05920.05810.05800.0587000000FD0.09930.10030.10030.10030.09930.10030.10130.10030.09930.10020.10120.09920.09920.1003000000ASTK0.07640.07720.07710.07720.07640.07710.07790.07710.07640.07710.07790.07640.07630.0771000000EXP0.05750.05810.05810.05810.05750.05810.05870.05810.05750.05800.05860.05750.05740.058000000CL0.05580.05640.05640.05640.05580.05640.05700.05640.05580.05640.05690.05580.05580.0564000000DSSK0.02400.02430.02430.02430.02400.02430.02450.02430.02400.02430.02450.02400.02400.0243000000PS0.04250.04300.04290.04300.04250.04290.04340.04290.04250.04290.04340.04250.04250.0429000000IV000000000000000.26830.26870.26780.26860.26840.2682SV000000000000000.14990.15010.14960.15000.14990.1498QN000000000000000.09660.09680.09650.09670.09670.0966TA000000000000000.15530.15560.15510.15550.15540.1553DA000000000000000.13500.13520.13480.13520.13510.1350IS000000000000000.12260.12280.12240.12270.12270.1226The final output (weights) is visually represented in Figure3. It is very clear from Figure 3 that” Interview (IV)” is the most suitable technique to be selected, then the second number “Task Analysis (TA)”, then third “Survey (SV)”, fourth “Document Analysis (DA)”, fifth “Introspection (IS)”, and the last one is “Questionnaire (QN)”. Hence, the result generated shows that the technique is the best among the others. So on the basis of attributes of software environment this selection of elicitation technique has been done. These results for IV were obtained based on the weights assigned and the calculation process of pair-wise comparison. The process of pair-wise comparisons is shown from Tables 4–7, and the final calculation of summary matrix is shown in Table 8, and limit matrix in Table 9. From these calculations, it is concluded to select the best option among alternatives. The selected technique is well applicable and reliable for its selection purpose.Figure 3
Graphical representation of weights of elicitation techniques.The managerial implications of the proposed approach are that it can help practitioners in a better way to select the most appropriate elicitation technique among the available techniques. As the approach is based on several attributes as criteria, so it deals with multiple perspectives of a project in a better way and can lead the project to success.


## 4.1. Weighted Super Matrix

A weighted super matrix is a matrix in which total sum of all the columns must be equal to or less than “1”; otherwise the matrix will be normalized to get weighted matrix. Table8 shows weighted super matrix.Table 8
Weighted super matrix.
SCOMESRACRQRSTKDOCINTFCOFDASTKEXPCLDSSKPSIVSVQNTADAISSCO0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.060.030.070.090.120.09MES0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.050.050.100.110.070.08RAC0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.150.150.060.070.040.18RQ0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.040.100.050.100.100.04RSTK0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.120.100.040.070.040.14DOC0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.030.100.040.040.210.03INT0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.030.040.040.160.080.02FCO0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.130.030.030.040.060.03FD0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.090.090.120.140.120.11ASTK0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.100.080.140.050.040.09EXP0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.080.080.030.040.040.09CL0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.070.060.140.030.030.05DSSK0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.020.030.040.030.030.02PS0.000.000.000.000.000.000.000.000.000.000.000.000.000.000.040.070.110.030.020.03IV0.490.240.360.150.200.150.160.370.220.340.350.400.140.430.000.000.000.000.000.00SV0.080.080.070.240.260.230.230.250.090.140.150.200.130.200.000.000.000.000.000.00QN0.060.060.050.080.050.110.120.170.100.120.120.160.360.140.000.000.000.000.000.00TA0.170.420.210.120.050.060.380.100.360.070.050.050.050.050.000.000.000.000.000.00DA0.130.150.170.370.050.400.070.070.160.050.060.070.240.070.000.000.000.000.000.00IS0.060.050.140.040.380.050.050.040.060.280.280.110.070.110.000.000.000.000.000.00


## 4.2. Limit Matrix

The values in the weighted super matrix are raised to the power until the rows in the weighted super matrix become the same and stable. The matrix obtained as a result of this process of the weighted super matrix is called the limit matrix. The limit matrix is the summarized form of all the pairwise comparison matrices. The limit matrix as shown in Table9 contains the priorities of all the elements which help the requirement engineer select a suitable technique with respect to project environment attributes.Table 9
Limit matrix.
SCOMESRACRQRSTKDOCINTFCOFDASTKEXPCLDSSKPSIVSVQNTADAISSCO0.06810.06890.06880.06890.06810.06880.06950.06880.06820.06880.06950.06810.06810.0688000000MES0.06550.06610.06610.06610.06550.06610.06680.06610.06550.06610.06680.06550.06540.066100000RAC0.10620.10730.10730.10730.10620.10730.10840.10730.10620.10730.10830.10620.10620.1073000000RQ0.06240.06300.06300.06300.06240.06300.06370.06300.06240.06300.06360.06240.06230.0630000000RSTK0.08540.08630.08620.08630.08540.08620.08710.08620.08540.08620.08710.08540.08530.0862000000DOC0.06480.06540.06540.06540.06480.06540.06610.06540.06480.06540.06600.06470.06470.0654000000INT0.05500.05560.05560.05560.05500.05560.05620.05560.05510.05560.05610.05500.05500.0556000000FCO0.05810.05870.05870.05870.05810.05870.05930.05870.05810.05870.05920.05810.05800.0587000000FD0.09930.10030.10030.10030.09930.10030.10130.10030.09930.10020.10120.09920.09920.1003000000ASTK0.07640.07720.07710.07720.07640.07710.07790.07710.07640.07710.07790.07640.07630.0771000000EXP0.05750.05810.05810.05810.05750.05810.05870.05810.05750.05800.05860.05750.05740.058000000CL0.05580.05640.05640.05640.05580.05640.05700.05640.05580.05640.05690.05580.05580.0564000000DSSK0.02400.02430.02430.02430.02400.02430.02450.02430.02400.02430.02450.02400.02400.0243000000PS0.04250.04300.04290.04300.04250.04290.04340.04290.04250.04290.04340.04250.04250.0429000000IV000000000000000.26830.26870.26780.26860.26840.2682SV000000000000000.14990.15010.14960.15000.14990.1498QN000000000000000.09660.09680.09650.09670.09670.0966TA000000000000000.15530.15560.15510.15550.15540.1553DA000000000000000.13500.13520.13480.13520.13510.1350IS000000000000000.12260.12280.12240.12270.12270.1226The final output (weights) is visually represented in Figure3. It is very clear from Figure 3 that” Interview (IV)” is the most suitable technique to be selected, then the second number “Task Analysis (TA)”, then third “Survey (SV)”, fourth “Document Analysis (DA)”, fifth “Introspection (IS)”, and the last one is “Questionnaire (QN)”. Hence, the result generated shows that the technique is the best among the others. So on the basis of attributes of software environment this selection of elicitation technique has been done. These results for IV were obtained based on the weights assigned and the calculation process of pair-wise comparison. The process of pair-wise comparisons is shown from Tables 4–7, and the final calculation of summary matrix is shown in Table 8, and limit matrix in Table 9. From these calculations, it is concluded to select the best option among alternatives. The selected technique is well applicable and reliable for its selection purpose.Figure 3
Graphical representation of weights of elicitation techniques.The managerial implications of the proposed approach are that it can help practitioners in a better way to select the most appropriate elicitation technique among the available techniques. As the approach is based on several attributes as criteria, so it deals with multiple perspectives of a project in a better way and can lead the project to success.


## 5. Conclusion

In the process of software development, the important thing is requirements, which if gathered properly, then the end product will be according to the need of the user; otherwise, it will be rejected. It means that the development of software system is highly dependent on requirements. For the purpose of eliciting suitable requirements, the most adequate technique selection is required. Hence, selection of suitable technique will gather the most appropriate requirements, which in turn increase productivity and will provide protection to software industry, to clients and system developer from useless efforts, cost, wastage of time, and other resources. The increase in software success ratio and prevention from failure is mainly dependent on elicitation technique selection based on project attributes of software environment. In this research, the method applied for the selection of elicitation technique must be the most suitable one based on attributes of software project environments. ANP, which is one of the MCDM approaches, is very useful to solve decisions, to structure, and to plan problems where multiple criteria are involved.In this research, the first step was to develop a network structure using ANP method, and the network structure designed is of goal, criteria, and alternatives associated with the criteria. In the network structure goal is to select suitable elicitation technique, criteria are project environment attributes, and alternatives are elicitation techniques. Due to this network structure requirement engineer understanding level becomes increased about elicitation techniques and project environment attributes. After network structure is designed in the next step, the weights are derived from well experienced persons (Experts), who worked in the software industry for years. The experts carried out the pairwise comparison of techniques with respect to attributes and then of attributes with respect to techniques. On the basis of this comparison, calculations have been done, which result in the Eigen values of the techniques and attributes. The consistency ratio was also calculated, which was less than 0.1 and was correct according to the rule. After weighted super and limit matrix were obtained, the limit matrix was actually the summarized form of all the matrices. After all the processes of pair-wise comparisons and calculating weighted and limit matrix, the results show clearly that IV with values 0.2683 and SV with values 0.1499 were the best choices among the available alternatives as they show high ranked values. The final results are obtained through limit matrix, which contains weights and on the basis of these weights, it can be very easy for a requirement engineer to take decision about most suitable technique selection. The proposed research results represent that the method is quite helpful, useful, and appropriate for decision making with respect to requirement elicitation technique selection. In the proposed study, it has been proved that the application of ANP method is very efficient for technique selection with respect to project environment attributes. In future, the proposed work can be extended by using some more efficient techniques like fuzzy ANP, fuzzy logic, roughest, and so on in order to ensure efficient selection of requirement elicitation technique.



---

*Source: 2156023-2020-09-08.xml*