# Quadrilateral Interval Type-2 Fuzzy Regression Analysis for Data Outlier Detection

Authors: Pingping Gao; Yabin Gao
Journal: Mathematical Problems in Engineering
 (2019)

---

## Abstract

This paper presents a fuzzy regression analysis method based on a general quadrilateral interval type-2 fuzzy numbers, regarding the data outlier detection. The Euclidean distance for the general quadrilateral interval type-2 fuzzy numbers is provided. In the sense of Euclidean distance, some parameter estimation laws of the type-2 fuzzy linear regression model are designed. Then, the data outlier detection-oriented parameter estimation method is proposed using the data deletion-based type-2 fuzzy regression model. Moreover, based on the fuzzy regression model, by using the root mean squared error method, an impact evaluation rule is designed for detecting data outlier. An example is finally provided to validate the presented methods.


---

## Body

## 1. Introduction

### 1.1. Related Works and Motivations

Regression analysis is widely used in engineering science, social science, economy, and finance [1–4] since it is a significant and comprehensive method to analyze the dependence between dependent variables and one or more variables. Generally, in a regression model, deviations (errors) between the estimated and the observed values are deemed to be because of random variations and/or measurement errors. To this end, some statistical analysis techniques are usually developed for model determination. Nevertheless, in practice, the deviations are sometimes caused by the indefiniteness of the system structure or the incomplete measurable data. In such a case, the uncertainties are ordinarily called fuzziness but not randomness. Then, to deal with the fuzziness, the regression analysis based on fuzzy data or fuzzy numbers called fuzzy regression analysis was proposed and developed in [5–7].Different from conventional regression techniques which are based on the nonstatistical method, fuzzy regression methodology uses possibility theory and fuzzy set theory [8, 9] for modeling and analysis. Thus, it is much appropriate to manage uncertainties. Zadeh [9] has introduced two types of fuzzy sets to describe the uncertainties [10–12]. The first type of fuzzy set called the type-1 fuzzy set has several typical extended forms, such as interval fuzzy set, triangular fuzzy set, trapezoidal fuzzy set, pentagonal fuzzy set, and intuitionistic fuzzy set [13]. Because of some variations in dealing with uncertainties, such as the inaccurate description of language uncertainties and the parameter perturbation in the uncertainties, the type-2 fuzzy set was presented to tackle this problem. Its degree of ambiguity is characterized by two subordinate membership functions. This is actually an extension of the type-1 one and leads to wider applicability for complex systems. But, in return, it makes the calculation of the fuzzy regression complicated when using type-2 fuzzy sets. For simplicity of calculation, Mendel et al. [14] specialized the type-2 fuzzy sets as a kind of interval type-2 fuzzy sets, which can also describe the uncertainties better over the type-1 fuzzy sets. In many research and applications of the fuzzy regression model, the fuzzy numbers based on triangular fuzzy sets are most frequently applied due to its simplicity. However, such fuzzy numbers manifest some limitations in observation, particularly when the complete observed output of the predicted model is required [15].In many practical studies, the complete description of regression problems greatly depends on the property of input-output data [16]. Different types of input-output data lead to dissimilar analysis results of the fuzzy regression. There are typically four cases of the fuzzy regression analysis. These are the cases based on the crisp-input crisp-output (CICO) [17], crisp-input fuzzy-output (CIFO) [15, 18], fuzzy-input crisp-output (FICO) [19], and fuzzy-input fuzzy-output (FIFO) [19–21] observations in the literature. Most commonly, the case of CIFO data is studied in practice. In this paper, the interested fuzzy regression is analyzed based on CIFO data. Specifically, the case where the predictor variable is crisp but the parameters (coefficients) are fuzzy is considered. Therefore, the observed responses, in this case, are naturally fuzzy.To sum up, there are three main methods of the fuzzy regression analysis, such as least squares fitting criterion, minimum fuzzy criterion, and interval regression analysis approach [22]. For example, in [23], mathematical programming methods were used for estimating the parameters of a fuzzy regression model in terms of the trapezoidal case and triangular case. The work in [24] developed a fuzzy regression model and used the least square method to estimate the coefficients in the sense of distance. The authors [15] presented a modified fuzzy linear model, based on which all the observed data can be enveloped by the identified model output. A tolerance approach was introduced in [25] to the construction of fuzzy regression coefficients based on a possibilistic linear regression model with fuzzy data. In this paper, the least square method will be used to calculate the estimation error of the fuzzy regression values.


### 1.2. Contributions of This Work

Actually, the kernel interval in a trapezoidal fuzzy number is limited to a single point equal to the midpoint of the support interval. As an extension of the triangular fuzzy numbers, the trapezoidal fuzzy numbers can fill those gaps. That is why we develop the fuzzy regression model using the trapezoidal interval type-2 fuzzy numbers and even use a more general case quadrilateral interval type-2 fuzzy numbers considered in this paper. Meanwhile, the model structure is assumed to be linear, which is commonly used in the literature. Consequently, the corresponding fuzzy regression problem becomes a parameter estimation problem of the regression model.In another research field, data information of all individuals often fails to be collected by experimenters due to measurement methods, preservation methods, and human factors. It results in incomplete observation values of some data indicators in the samples, which are common in clinical trials, socioeconomic statistics, environmental ecology, and other researches. In fact, under normal circumstances, samples with missing values cannot fully reflect the real characteristics of interested systems and the internal relationship between variables. Thus, improper treatment may even lead to large deviations in the results. Therefore, how to deal with the missing data and extract information from data correctly and effectively is an important issue in statistical inference.However, it is often unavoidable to mix a certain proportion of outliers or strong influence points into the actual data due to the interference of many factors, such as negligence error and rounding error. Once the outliers are mixed, these fuzzy regression methods will become unpractical and even severe challenges can even lead to wrong conclusions. It results in incomplete observation values of some data indicators in the samples, which are common in clinical trials, socioeconomic statistics, environmental ecology, and other researches [26–28]. Hence, the influence analysis of outliers on models is an important part of the statistical diagnosis. To this end, this paper will investigate the fuzzy regression analysis based on the type-2 trapezoidal fuzzy numbers regarding the data outlier detection. The contributions of the paper can be summarized as follows:(1)
Firstly, the definition of interval trapezoidal type-2 fuzzy numbers is provided. The parameter estimation laws of the fuzzy linear regression model based on trapezoidal fuzzy numbers are designed in the sense of Euclidean distance.(2)
Then, some parameter estimation laws in terms of the data outlier detection are synthesized for the trapezoidal fuzzy regression model.(3)
Moreover, based on the trapezoidal fuzzy linear regression model, the impact evaluation rule is established by using the root mean squared error method.The rest of the paper is organized as follows. Section2 describes the fuzzy linear regression model and the quadrilateral type-2 fuzzy numbers. Sections 3 and 4 present parameter estimation laws of the fuzzy regression model. Section 5 provides the impact evaluation rule. Section 7 summarizes the paper.


## 1.1. Related Works and Motivations

Regression analysis is widely used in engineering science, social science, economy, and finance [1–4] since it is a significant and comprehensive method to analyze the dependence between dependent variables and one or more variables. Generally, in a regression model, deviations (errors) between the estimated and the observed values are deemed to be because of random variations and/or measurement errors. To this end, some statistical analysis techniques are usually developed for model determination. Nevertheless, in practice, the deviations are sometimes caused by the indefiniteness of the system structure or the incomplete measurable data. In such a case, the uncertainties are ordinarily called fuzziness but not randomness. Then, to deal with the fuzziness, the regression analysis based on fuzzy data or fuzzy numbers called fuzzy regression analysis was proposed and developed in [5–7].Different from conventional regression techniques which are based on the nonstatistical method, fuzzy regression methodology uses possibility theory and fuzzy set theory [8, 9] for modeling and analysis. Thus, it is much appropriate to manage uncertainties. Zadeh [9] has introduced two types of fuzzy sets to describe the uncertainties [10–12]. The first type of fuzzy set called the type-1 fuzzy set has several typical extended forms, such as interval fuzzy set, triangular fuzzy set, trapezoidal fuzzy set, pentagonal fuzzy set, and intuitionistic fuzzy set [13]. Because of some variations in dealing with uncertainties, such as the inaccurate description of language uncertainties and the parameter perturbation in the uncertainties, the type-2 fuzzy set was presented to tackle this problem. Its degree of ambiguity is characterized by two subordinate membership functions. This is actually an extension of the type-1 one and leads to wider applicability for complex systems. But, in return, it makes the calculation of the fuzzy regression complicated when using type-2 fuzzy sets. For simplicity of calculation, Mendel et al. [14] specialized the type-2 fuzzy sets as a kind of interval type-2 fuzzy sets, which can also describe the uncertainties better over the type-1 fuzzy sets. In many research and applications of the fuzzy regression model, the fuzzy numbers based on triangular fuzzy sets are most frequently applied due to its simplicity. However, such fuzzy numbers manifest some limitations in observation, particularly when the complete observed output of the predicted model is required [15].In many practical studies, the complete description of regression problems greatly depends on the property of input-output data [16]. Different types of input-output data lead to dissimilar analysis results of the fuzzy regression. There are typically four cases of the fuzzy regression analysis. These are the cases based on the crisp-input crisp-output (CICO) [17], crisp-input fuzzy-output (CIFO) [15, 18], fuzzy-input crisp-output (FICO) [19], and fuzzy-input fuzzy-output (FIFO) [19–21] observations in the literature. Most commonly, the case of CIFO data is studied in practice. In this paper, the interested fuzzy regression is analyzed based on CIFO data. Specifically, the case where the predictor variable is crisp but the parameters (coefficients) are fuzzy is considered. Therefore, the observed responses, in this case, are naturally fuzzy.To sum up, there are three main methods of the fuzzy regression analysis, such as least squares fitting criterion, minimum fuzzy criterion, and interval regression analysis approach [22]. For example, in [23], mathematical programming methods were used for estimating the parameters of a fuzzy regression model in terms of the trapezoidal case and triangular case. The work in [24] developed a fuzzy regression model and used the least square method to estimate the coefficients in the sense of distance. The authors [15] presented a modified fuzzy linear model, based on which all the observed data can be enveloped by the identified model output. A tolerance approach was introduced in [25] to the construction of fuzzy regression coefficients based on a possibilistic linear regression model with fuzzy data. In this paper, the least square method will be used to calculate the estimation error of the fuzzy regression values.


## 1.2. Contributions of This Work

Actually, the kernel interval in a trapezoidal fuzzy number is limited to a single point equal to the midpoint of the support interval. As an extension of the triangular fuzzy numbers, the trapezoidal fuzzy numbers can fill those gaps. That is why we develop the fuzzy regression model using the trapezoidal interval type-2 fuzzy numbers and even use a more general case quadrilateral interval type-2 fuzzy numbers considered in this paper. Meanwhile, the model structure is assumed to be linear, which is commonly used in the literature. Consequently, the corresponding fuzzy regression problem becomes a parameter estimation problem of the regression model.In another research field, data information of all individuals often fails to be collected by experimenters due to measurement methods, preservation methods, and human factors. It results in incomplete observation values of some data indicators in the samples, which are common in clinical trials, socioeconomic statistics, environmental ecology, and other researches. In fact, under normal circumstances, samples with missing values cannot fully reflect the real characteristics of interested systems and the internal relationship between variables. Thus, improper treatment may even lead to large deviations in the results. Therefore, how to deal with the missing data and extract information from data correctly and effectively is an important issue in statistical inference.However, it is often unavoidable to mix a certain proportion of outliers or strong influence points into the actual data due to the interference of many factors, such as negligence error and rounding error. Once the outliers are mixed, these fuzzy regression methods will become unpractical and even severe challenges can even lead to wrong conclusions. It results in incomplete observation values of some data indicators in the samples, which are common in clinical trials, socioeconomic statistics, environmental ecology, and other researches [26–28]. Hence, the influence analysis of outliers on models is an important part of the statistical diagnosis. To this end, this paper will investigate the fuzzy regression analysis based on the type-2 trapezoidal fuzzy numbers regarding the data outlier detection. The contributions of the paper can be summarized as follows:(1)
Firstly, the definition of interval trapezoidal type-2 fuzzy numbers is provided. The parameter estimation laws of the fuzzy linear regression model based on trapezoidal fuzzy numbers are designed in the sense of Euclidean distance.(2)
Then, some parameter estimation laws in terms of the data outlier detection are synthesized for the trapezoidal fuzzy regression model.(3)
Moreover, based on the trapezoidal fuzzy linear regression model, the impact evaluation rule is established by using the root mean squared error method.The rest of the paper is organized as follows. Section2 describes the fuzzy linear regression model and the quadrilateral type-2 fuzzy numbers. Sections 3 and 4 present parameter estimation laws of the fuzzy regression model. Section 5 provides the impact evaluation rule. Section 7 summarizes the paper.


## 2. Model Description and Preliminaries

x
i
,
y
i is denoted as a set of pairs of observation data, where xi∈ℝ is the predictor variable (input) and yi∈ℝ is the observed response variable (output), and i=1,2,…,n. For each observation data xi,yi, the functional form of the linear regression model is formulated as(1)yi=α+βxi,where α∈ℝ and β∈ℝ are the unknown parameters to be estimated.Some definitions used in developing the theoretical results are presented in Appendix.The uncertainty of a type-2 fuzzy setsF can be described by a bounded region, that is, the projection area of the fuzzy sets F on the plane x,u, which is called the footprint of uncertainty, expressed by μFx,u. The upper-bound membership function μFUx,u and the lower-bound membership function μFUx,u of the interval type-2 fuzzy numbers are actually corresponding to type-1 fuzzy sets, respectively.An illustrative description and comparison of the type-2 membership functions under different cases is shown in Figure1. From Figures 1(a) and 1(b), we know that the considered trapezoidal membership function (2) as shown in Figure 1(b) is a special case of the quadrilateral membership function [29], where hs and ht are the membership values of the second and third elements a2 and a3, respectively. The mostly used triangular type-2 membership function illustrated in Figure 1(c) is actually a special case of the trapezoidal one considered in this paper. Figure 1(d) shows a crisp value of a fuzzy set by comparing with the mentioned fuzzy numbers.Figure 1
Illustration of the type-2 fuzzy numbers: (a) a general quadrilateral number case; (b) a general trapezoidal number case; (c) a general triangular number case; (d) the crisp number case.
(a)
(b)
(c)
(d)The upper- and lower-bound membership functions of the trapezoidal type-2 fuzzy numbers are expressed as the following form:(2)μFUx,hU=hU⋅x−a1Ua2U−a1U,a1U<x<a2U,hU,a2U≤x≤a3U,hU⋅a4U−xa4U−a3U,a3U<x<a4U,0,else,μFLx,hL=hL⋅x−a1La2L−a1L,a1L<x<a2L,hL,a2L≤x≤a3L,hL⋅a4L−xa4L−a3L,a3L<x<a4L,0,else,where a1U≤a2U≤a3U≤a4U and a1L≤a2L≤a3L≤a4L are nonnegative real numbers, a1U≤a1L, a4L≤a4U, and 0≤hL≤hU≤1 denote the heights of the two trapezoids. Considering hs≠ht, we give the following definition of general quadrilateral interval type-2 fuzzy numbers.Based on this discussion above, we will analyze the regression model (3) for the general case when the quadrilateral type-2 fuzzy numbers are used. The CIFO-based interval type-2 fuzzy regression model is formulated as follows:(3)y˜i=α˜+β˜xi,where α˜ and β˜ denote the two fuzzy numbers, which are quadrilateral interval type-2 fuzzy numbers considered in this paper. y˜i is the observed response i=1,2,…,n. Before proceeding further, we give the following definition of the Euclidean distance of two quadrilateral interval type-2 fuzzy numbers.Remark 1.
The coefficientsa and b used in (A.6) can be adjusted as needed. If a=b=1/2, then the Euclidean distance dF1,F2 is called the centralized Euclidean distance.
In the following section, the fuzzy regression is analyzed in the sense of the defined Euclidean distance, for the estimation of theα˜ and β˜ in (3). Furthermore, the parameter estimation in terms of the data outlier will be also discussed subsequently.


## 3. Parameter Estimation of the Type-2 Fuzzy Regression Model

For the considered CIFO observation data, we write the interval type-2 fuzzy parametersα˜ and β˜ in (3) as follows:(4)α˜=α1U,α2U,α3U,α4U;hαUs,hαUt,α1L,α2L,α3L,α4L;hαLs,hαLt,(5)β˜=β1U,β2U,β3U,β4U;hβUs,hβUt,β1L,β2L,β3L,β4L;hβLs,hβLt.According to (3), the fuzzy-observed response y˜i can be represented subject to the positive or negative xi. If xi>0, then the corresponding quadrilateral type-2 fuzzy number is(6)α1U+β1Uxi,hαUsα2U+hβUsβ2Uxi,hαUtα3+hβUtβ3Uxi,α4U+β4Uxi,α1L+β1Lxi,hαLsα2L+hβLsβ2Lxi,hαLtα3+hβLtβ3Lxi,α4L+β4Lxi.On the contrary, ifxi<0, the corresponding type-2 fuzzy number results in(7)α1U+β4Uxi,hαUsα2U+hβUtβ3Uxi,hαUtα3U+hβUsβ2Uxi,α4U+β1Uxi,α1L+β4Lxi,hαLsα2L+hβLtβ3Lxi,hαLtα3L+hβLsβ2Lxi,α4L+β1Lxi.Remark 2.
Actually, one can find the minimumxmin from all xi whether it is positive or negative and then subtract xmin for each xi, that is xi=xi−xmin. Thus, a new set of xi which are all nonnegative are obtained. Therefore, we will investigate the regression analysis by considering xi≥0 in (3).
Based on the fuzzy regression model (3), we aim to design the estimates of the bounds of α˜ and β˜ by minimizing the distance between the resulting fuzzy number and the observed response y˜i. As discussed in Remark 2, we can consider the case of xi≥0, for the parameter estimation. We provide the estimation laws for the general case of the membership grades hrκs and hrκt r∈α,β,κ∈U,L, in the following theorem.Theorem 1.
Consider the fuzzy regression modely˜i=α˜+β˜xi with a set of observation data xi,y˜i, i=1,2,…,n. For the quadrilateral type-2 fuzzy parameters α˜ and β˜ in (4)-(5), if the observed data y˜i are a set of quadrilateral type-2 fuzzy numbers y˜i=yi1U,yi2U,yi3U,yi4U,yi1L,yi2L,yi3L,yi4L, then the estimates of α˜ and β˜ in the Euclidean distance sense are designed as follows:(8)α^1κ=∑i=1nxiyi1κ∑i=1nxi−∑i=1nxi2∑i=1nyi1κ∑i=1nxi2−n∑i=1nxi2,α^2κ=∑i=1nxiyi2κ∑i=1nxi−∑i=1nxi2∑i=1nyi2κhακs∑i=1nxi2−n∑i=1nxi2,α^3κ=∑i=1nxiyi3κ∑i=1nxi−∑i=1nxi2∑i=1nyi3κhακt∑i=1nxi2−n∑i=1nxi2,α^4κ=∑i=1nxiyi4κ∑i=1nxi−∑i=1nxi2∑i=1nyi4κ∑i=1nxi2−n∑i=1nxi2,β^1κ=∑i=1nxi∑i=1nyi1κ−n∑i=1nxiyi1κ∑i=1nxi2−n∑i=1nxi2,β^2κ=∑i=1nxi∑i=1nyi2κ−n∑i=1nxiyi2κhβκs∑i=1nxi2−n∑i=1nxi2,β^3κ=∑i=1nxi∑i=1nyi3κ−n∑i=1nxiyi3κhβκt∑i=1nxi2−n∑i=1nxi2,β^4κ=∑i=1nxi∑i=1nyi4κ−n∑i=1nxiyi4κ∑i=1nxi2−n∑i=1nxi2,where κ∈U,L.Proof.
According to Definition 4, forn observation pairs xi,y˜i, the sum sα˜,β˜ of the squared Euclidean distance between y˜i and α˜+β˜xi subject to the fuzzy numbers α˜ and β˜ can be obtained as follows:(9)sα˜,β˜=∑i=1ndEy˜i,α˜+β˜xi=∑i=1na⋅dUyiU,α˜U+β˜Uxi+∑i=1nb⋅dLyiL,α˜L+β˜Lxi=a⋅14∑i=1nyi1U−α1U+β1Uxi2+yi2U−hαUsα2U+hβUsβ2Uxi2+yi3U−hαUtα3U+hβUtβ3Uxi2+yi4U−α4U+β4Uxi21/2+b⋅14∑i=1nyi1L−α1L+β1Lxi2+yi2L−hαLsα2L+hβLsβ2Lxi2+yi3L−hαLtα3+hβLtβ3Lxi2+yi4L−α4L+β4Lxi21/2
Then, we take the partial derivative ofsα˜,β˜ with respect to α^τκ and β^τκ (τ=1,2,3,4 and κ∈U,L) and receptively obtain the following equations for κ∈U,L:(10)∂s∂α1κ=∑i=1nyi1κ−α1κ+β1κxi=0,∂s∂α2κ=∑i=1nyi2κ−hακsα2κ+hβκsβ2κxi=0,∂s∂α3κ=∑i=1nyi3κ−hακtα3κ+hβκtβ3κxi=0,∂s∂α4κ=∑i=1nyi4κ−α4κ+β4κxi=0,∂s∂β1κ=∑i=1nyi1κ−α1κ+β1κxixi=0,∂s∂β2κ=∑i=1nyi2κ−hακsα2κ+hβκsβ2κxixi=0,∂s∂β3κ=∑i=1nyi3κ−hακtα3κ+hβκtβ3κxixi=0,∂s∂β4κ=∑i=1nyi4κ−α4κ+β4κxixi=0.
Let(11)α^=α^1U,α^2U,α^3U,α^4U;hαUs,hαUt,α^1L,α^2L,α^3L,α^4L;hαLs,hαLt,β^=β^1U,β^2U,β^3U,β^4U;hβUs,hβUt,β^1L,β^2L,β^3L,β^4L;β^βLs,hβLt,be the estimates of α˜ and β˜, respectively. Then, solving the algebraic equation sets obtained above, we get the estimates of the bounds of α˜ and β˜ as exactly expressed in Theorem 1. This completes the proof.


## 4. Parameter Estimation against the Data Deletion Fuzzy Regression Model

For the sake of the evaluation of the impact of thej-th data xj,y˜j in regression analysis based on the regression model (3), we can delete the j-th data xj,y˜j and detect if these data are an outlier or a strong influence factor, by comparing the changes in statistical inference results. The regression model (1) when the j-th data xj,y˜j are deleted is called the data deletion-based regression model, which is represented as(12)y˜j=α˜j+β˜jx,j∈1,2,…,n,where α˜j and β˜j are the two quadrilateral interval type-2 fuzzy parameters.By the parameter estimation method in Theorem 1, the following results can be drawn for the parameter estimation against thej-th data deleted.Theorem 2.
Consider the trapezoidal fuzzy regression model (12) with a set of observation data xi,y˜i, i=1,2,…,n, and y˜i=yi1U,yi2U,yi3U,yi4U,yi1L,yi2L,yi3L,yi4L is a class of quadrilateral interval type-2 fuzzy number. If the j-th data point xj,y˜j is deleted, then the following estimates of α˜j and β˜j in the Euclidean distance are designed for i,j=1,2,…,n.(13)α^1jκ=∑i≠jxiyi1κ∑i≠jxi−∑i≠jxi2∑i≠jyi1κ∑i≠jxi2−n−1∑i≠jxi2,α^2jκ=∑i≠jxiyi2κ∑i≠jxi−∑i≠jxi2∑i≠jyi2κhακs∑i≠jxi2−n−1∑i≠jxi2,α^3jκ=∑i≠jxiyi3κ∑i≠jxi−∑i≠jxi2∑i≠jyi3κhακt∑i≠jxi2−n−1∑i≠jxi2,α^4jκ=∑i≠jxiyi4κ∑i≠jxi−∑i≠jxi2∑i≠jyi4κ∑i≠jxi2−n−1∑i≠jxi2,β^1jκ=∑i≠jxi∑i≠jyi1κ−n−1∑i≠jxiyi1κ∑i≠jxi2−n−1∑i≠jxi2,β^2jκ=∑i≠jxi∑i≠jyi2κ−n−1∑i≠jxiyi2κhβκs∑i≠jxi2−n−1∑i≠jxi2,β^3jκ=∑i≠jxi∑i≠jyi3κ−n−1∑i≠jxiyi3κhβκt∑i≠jxi2−n−1∑i≠jxi2,β^4jκ=∑i≠jxi∑i≠jyi4κ−n−1∑i≠jxiyi4κ∑i≠jxi2−n−1∑i≠jxi2,where κ∈U,L.Proof.
Similar to the case ofsα˜,β˜ in Theorem 1, after the j-th data xi,y˜i are deleted, the sum sα˜j,β˜j of the squared Euclidean distance between y˜i and α˜j+β˜jxi results in the following, for i,j=1,2,…,n:(14)sα˜j,β˜j=∑i≠jdEy˜i,α˜+β˜xi=∑i≠ja⋅dUyiU,α˜U+β˜Uxi+∑i≠jb⋅dLyiL,α˜L+β˜Lxi=a⋅14∑i≠jyi1U−α1jU+β1jUxi2+yi2U−hαUsα2jU+hβUsβ2jUxi2+yi3U−hαUtα3jU+hβUtβ3jUxi2+yi4U−α4jU+β4jUxi21/2+b⋅14∑i≠jyi1L−α1jL+β1jLxi2+yi2L−hαLsα2jL+hβLsβ2jLxi2+yi3L−hαLtα3j+hβLtβ3jLxi2+yi4L−α4jL+β4jLxi21/2.
Then, following the steps in the proof of Theorem 1, the results in Theorem 2 can be obtained accordingly. We omit the specific proof for saving space.


## 5. Impact Evaluation Rule for the Data Outlier Detection

Sincey˜j and y˜ introduced above are two type-2 fuzzy numbers, it is inconvenient to compare their difference. For this reason, a suitable statistical measure is usually suggested in order to compare the impact quantitatively. In this paper, we introduce the standard deviation of the regression equation as the statistical measure to analysis the impact of the data deletion. Let us define the standard deviation of the regression equation (3) as Definition 5 in Appendix.From Definition 5, we know that the standard deviation of the regression equation is actually the average deviation between the observed value and the estimated value. Apparently, the smaller the standard deviation is, the closer the estimated value is to the observed value, as well as the closer the observation points are clustered around the fuzzy regression model.When calculating the standard error in (A.8), we should firstly obtain the parameters α˜ and β˜ by solving the extreme-value problem in the statistical analysis and then estimate the regression value. It will use two rounds of statistical calculations, and thus, two degrees of freedom are taken. Therefore, the denominator in (A.8) uses n−2 and not n in the statistical analysis.According to the data deletion-based type-2 fuzzy regression model (12), when the j-th data point is deleted, the corresponding standard deviation is(15)σj=1n−3∑i≠jdE2y˜ij,y˜^ij1/2.Specifically, the square ofσj for the type-2 fuzzy regression model (12) with fuzzy α˜ and fuzzy β˜ can be calculated by(16)sα˜j,β˜j=an−3⋅14∑i≠jyi1U−α^1jU+β^1jUxi2+yi2U−hαUsα^2jU+hβUsβ^2jUxi2+yi3U−hαUtα^3jU+hβUtβ^3jUxi2+yi4U−α^4jU+β^4jUxi21/2+bn−3⋅14∑i≠jyi1L−α^1jL+β^1jLxi2+yi2L−hαLsα^2jL+hβLsβ^2jLxi2+yi3L−hαLtα^3j+hβLtβ^3jLxi2+yi4L−α^4jL+β^4jLxi21/2,where α^τjκ and β^τjκ (τ=1,2,3,4 and κ∈U,L) are defined in Theorem 2.For the data deletion-based fuzzy linear regression model in (12), let σj2 be the metric of the impact on the regression model (12). Evidently, if σj2 increases after deleting the j-th data point, then it indicates that the impact is greater and this data point may be an outlier; otherwise, the j-th data are normal.The derived results can be reduced to the case of trapezoidal type-2 fuzzy regression model whenhrκs=hrκt (r∈α,β, κ∈U,L). Besides, it becomes the normal case when using hrκs=hrκt=1. Therefore, one can consider α2κ=α3κ and β2κ=β3κ (κ∈U,L) when dealing with the triangular type-2 fuzzy numbers in practice.


## 6. Simulation Example

In this part, we provide an example to validate the presented fuzzy regression model and the designed impact evaluation rule for the data outlier detection. We borrow a set of data; these are the estimation errors produced in Table 9 from [30] but considered as some type-2 trapezoidal fuzzy numbers. Table 1 gives the considered interval type-2 trapezoidal fuzzy numbers as the observed data.Table 1
A set of interval type-2 trapezoidal fuzzy numbers.
x
i
y
˜
i
=
y
i
1
L
,
y
i
2
L
,
y
i
3
L
,
y
i
4
L
,
y
i
1
U
,
y
i
2
U
,
y
i
3
U
,
y
i
4
U
1
((1, 38.09, 36.43, 5), (1, 43.09, 41.43, 5))
2
((1, 62.10, 26.50, 6), (1, 67.10, 31.50, 6))
3
((1, 63.76, 44.71, 7), (1, 68.76, 49.71, 7))
4
((1, 74.52, 38.09, 8), (1, 79.52, 43.09, 8))
5
((1, 75.38, 41.40, 7), (1, 80.38, 46.40, 7))
6
((2, 52.99, 26.49, 4), (2, 57.99, 31.49, 4))
7
((2, 62.93, 26.49, 5), (2, 68.93, 31.49, 5))
8
((2, 72.04, 33.12, 6), (2, 77.04, 38.12, 6))
9
((2, 76.12, 43.06, 7), (2, 81.12, 47.06, 7))
10
((2, 90.26, 42.64, 7), (2, 95.26, 47.64, 7))
11
((3, 85.70, 31.33, 6), (3, 90.70, 36.33, 6))
12
((3, 95.27, 27.64, 6), (3, 100.27, 32.64, 6))
13
((3, 105.98, 27.64, 6), (3, 110.98, 32.64, 6))
14
((3, 79.25, 66.81, 6), (3, 84.25, 71.81, 6))
15
((3, 120.5, 32.25, 6), (3, 125.5, 37.25, 6))Based on this set of observed data, we will detect if some of them is an outlier or a strong impact point by using the designed impact evaluation rule. For simplicity, we use the normal trapezoidal type-2 fuzzy numberhrκs=hrκt=1 (r∈α,β, κ∈U,L) for the type-2 fuzzy parameters α˜ and β˜. Considering y˜i=α˜+β˜xi, according to Theorem 1, by setting a=b=0.5, we obtain α˜ and β˜ of the resulting type-2 fuzzy regression equation as follows:(17)y˜i=0.5714,45.7767,33.3210,6.1619,0.5714,50.8719,38.2936,6.1619+0.1786,3.8984,0.3680,0.0036,0.1786,3.902,0.3725,0.0036xi.Then, in the following steps, we can use this fuzzy regression equation to calculate the standard deviation of the regression value after deleting thej-th data point. Based on the fuzzy regression model (17), according to Theorem 2, we can obtain the standard deviations as shown in Table 2.Table 2
Type-2 fuzzy regression equations and standard deviations.
j
y
˜
^
j
=
α
˜
^
j
+
β
˜
^
j
x
σ
j
1
y
˜
^
1
=
0.3481
,
35.8901
,
23.2961
,
4.7294
,
0.3481
,
39.5816
,
26.8681
,
4.7294
+
0.1998
,
4.8609
,
1.3330
,
0.1349
,
0.1998
,
4.9922
,
1.4630
,
0.1349
x
3.2136
2
y
˜
^
2
=
0.4029
,
31.6737
,
26.0378
,
4.5454
,
0.4029
,
35.4237
,
29.6711
,
4.5454
+
0.1945
,
5.2346
,
1.0800
,
0.1509
,
0.1945
,
5.3596
,
1.2033
,
0.1509
x
3.2195
3
y
˜
^
3
=
0.4438
,
32.8212
,
24.4961
,
4.4172
,
0.4438
,
36.6187
,
26.5234
,
4.4172
+
0.1909
,
5.1180
,
1.3435
,
0.1601
,
0.1909
,
5.2380
,
1.4615
,
0.1601
x
3.2234
4
y
˜
^
4
=
0.4730
,
32.3155
,
24.4282
,
4.3368
,
0.4730
,
37.2279
,
28.2206
,
4.3368
+
0.1888
,
5.1348
,
1.1980
,
0.1633
,
0.1888
,
5.2508
,
1.3117
,
0.1633
x
3.2230
5
y
˜
^
5
=
0.4920
,
33.3609
,
26.3388
,
4.5550
,
0.4920
,
40.4477
,
28.1861
,
4.5550
+
0.1880
,
5.0356
,
1.1885
,
0.1450
,
0.1880
,
5.1486
,
1.2988
,
0.1450
x
3.2196
6
y
˜
^
6
=
0.4238
,
36.5563
,
26.2742
,
4.9166
,
0.3988
,
39.7070
,
30.1144
,
4.9166
+
0.1931
,
4.8557
,
1.0791
,
0.1250
,
0.1931
,
4.9665
,
1.1873
,
0.1250
x
3.2144
7
y
˜
^
7
=
0.3988
,
35.8756
,
25.8062
,
4.8110
,
0.4238
,
39.4080
,
30.0801
,
4.8110
+
0.1915
,
4.9011
,
1.0965
,
0.1312
,
0.1915
,
5.0119
,
1.2023
,
0.1312
x
3.2122
8
y
˜
^
8
=
0.4395
,
35.4849
,
25.4929
,
4.7472
,
0.4395
,
39.3816
,
29.6279
,
4.7472
+
0.1911
,
4.9158
,
1.1097
,
0.1320
,
0.1911
,
5.0243
,
1.2144
,
0.1320
x
3.2102
9
y
˜
^
9
=
0.4462
,
35.4506
,
25.6790
,
4.7241
,
0.4462
,
39.2298
,
29.3570
,
4.7241
+
0.1919
,
4.9280
,
1.0725
,
0.1273
,
0.1919
,
5.0364
,
1.1814
,
0.1273
x
3.2116
10
y
˜
^
10
=
0.4440
,
35.2958
,
25.6184
,
4.7500
,
0.4440
,
39.2140
,
29.5176
,
4.7500
+
0.1940
,
4.8653
,
1.0607
,
0.1250
,
0.1940
,
4.9743
,
1.16541
,
0.1250
x
3.2118
11
y
˜
^
11
=
0.4486
,
35.2823
,
25.2493
,
4.7538
,
0.4486
,
39.3073
,
29.4576
,
4.7538
+
0.1859
,
4.9537
,
1.1826
,
0.1347
,
0.1859
,
5.0640
,
1.2877
,
0.1347
x
3.2116
12
y
˜
^
12
=
0.4522
,
35.3835
,
24.8214
,
4.7428
,
0.4522
,
39.7222
,
29.0843
,
4.7428
+
0.1871
,
4.8969
,
1.2789
,
0.1375
,
0.1871
,
5.0093
,
1.3856
,
0.1375
x
3.2138
13
y
˜
^
13
=
0.4462
,
35.8126
,
24.8603
,
4.7242
,
0.4462
,
39.7410
,
28.6852
,
4.7242
+
0.1897
,
4.7824
,
1.3454
,
0.1414
,
0.1897
,
4.8979
,
1.4545
,
0.1414
x
3.2163
14
y
˜
^
14
=
0.4294
,
32.8700
,
28.2698
,
4.6966
,
0.4294
,
36.7583
,
32.0779
,
4.6966
+
0.1939
,
5.4961
,
0.5061
,
0.1466
,
0.1939
,
5.6157
,
0.6186
,
0.1466
x
3.2532
15
y
˜
^
15
=
0.4000
,
36.8730
,
24.3806
,
4.6583
,
0.4000
,
40.7314
,
28.1642
,
4.6583
+
0.2000
,
4.5837
,
1.3957
,
0.1535
,
0.2000
,
4.7087
,
1.5128
,
0.1535
x
3.2187From the standard deviations in Table2, after deleting the 14-th data point, one can find that the standard deviation of the estimate of the fuzzy regression equation is larger than those of others. This can be observed evidently from Figure 2. Thus, the 14-th data point is likely the outlier point, which means the estimation error obtained in Table 1 is the least-accurate estimation error.Figure 2
Standard deviations of the estimates of the fuzzy regression equations.


## 7. Conclusion

This paper has dealt with the problems of the fuzzy regression analysis and data outlier detection based on general quadrilateral interval type-2 fuzzy numbers. The Euclidean distance for the type-2 fuzzy numbers has been provided and used for the parameter estimation and standard deviation. Some parameter estimation laws of the quadrilateral interval type-2 fuzzy linear regression model have been designed. Finally, the impact evaluation rule has been designed using the data deletion-based fuzzy regression model. The data outlier detection can be achieved by using the calculation of the standard deviations of the fuzzy regression values.



---

*Source: 4914593-2019-08-21.xml*