# Stable Portfolio Selection Strategy for Mean-Variance-CVaR Model under High-Dimensional Scenarios

Authors: Yu Shi; Xia Zhao; Fengwei Jiang; Yipin Zhu
Journal: Mathematical Problems in Engineering
 (2020)

---

## Abstract

This paper aims to study stable portfolios with mean-variance-CVaR criteria for high-dimensional data. Combining different estimators of covariance matrix, computational methods of CVaR, and regularization methods, we construct five progressive optimization problems with short selling allowed. The impacts of different methods on out-of-sample performance of portfolios are compared. Results show that the optimization model with well-conditioned and sparse covariance estimator, quantile regression computational method for CVaR, and reweightedL1 norm performs best, which serves for stabilizing the out-of-sample performance of the solution and also encourages a sparse portfolio.


---

## Body

## 1. Introduction

Mean-risk models are widely used and play an important role in financial risk management. The classical and revolutionary work is mean-variance (MV) optimization model proposed by Markowitz [1], in which variance is used to measure risk. Afterwards, more and more researchers are devoted to the study of this field. Kolm et al. [2] review the development, challenges, and trends of MV optimization problems in recent six decades. Considering different risk measures focus on different characteristics of risk, some risk measures other than variance are incorporated into the mean-risk framework. For example, Konno and Yamazaki [3] and Ogryczak and Ruszczynski [4] use absolute deviation and semideviation to measure risk, respectively, and construct mean-risk model for portfolio selection. Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) have been employed as the risk measure to conduct asset allocation (see Consigli [5], Alexander and Baptista [6], Xu et al. [7], and Quaranta and Zaffaroni [8] for more details).Since different risk measures delineate different information of risk, the combination of two risk measures is used to control risk in mean-risk models. For instance, Konno et al. [9] and Konno and Suzuki [10] construct mean-absolute deviation-skewness model and mean-variance-skewness model, respectively, in which the skewness is indicative of unidirectional movement (bearish or bullish) of the stock market. Robert and Philip [11] propose a mean-variance-skewness-kurtosis portfolio optimization model and show that higher-order moments of return can significantly change optimal portfolio construction. Roman et al. [12] construct an optimization model based on mean-variance-CVaR criterion, in which variance and CVaR are combined to obtain a range of balanced solutions that are generally discarded by both mean-variance and mean-CVaR models. Additionally, the personal preference between variance and CVaR of the decision-maker can be considered. Gao et al. [13] extend it to dynamic scenario in financial field and Shi et al. [14] give the discussion in insurance investment under regulatory constraints. However, the study of the stability of optimal strategy’s out-of-sample performance is ready to explore under mean-variance-CVaR criterion. Thus, the adaptability of optimal investment strategy in practice is questionable, especially in high-dimensional scenarios (dimensionality of assets is comparable to or even larger than the number of observations). Here, we will study this problem from the point of view of model-solving procedure.To solve mean-variance-CVaR optimization problem, the computation of variance and CVaR for portfolios is a central and fundamental work. For variance term, estimating covariance matrix of the return variables of assets is necessary. Generally, sample covariance matrix is a good estimator when sample size is large sufficiently. But under high-dimensional scenarios, it usually delivers the presence of poor out-of-sample performance (see, e.g., Green and Hollifield [15]; Chopra and Ziemba [16]; DeMiguel et al. [17]). To deal with such instable out-of-sample performance, researchers make various contributions. Based on different thresholding function, thresholding covariance matrix estimator is one of the mainstreams of improving sample covariance matrix by considering sparsity (e.g., Tibshirani [18]; Bickel and Levin’a [19]; Cai et al. [20]). Moreover, to guarantee the presence of a convex optimization problem, Rothman et al. [21] propose the positive definite sparse covariance estimator (PDSCE). While considering the property of well condition, Ledoit and Wolf [22] propose an estimator of covariance matrix as a linear combination of sample covariance and identity matrix. Maurya [23] develops a well-conditioned and sparse estimator of covariance matrix in high-dimensional setting. This estimator has the properties of well-conditioned, sparsity, and positive definite; especially, the property of positive definite guarantees a convex optimization problem and it performs better than several other popular methods used in literatures (e.g., graphical lasso in Friedman et al. [24], PDSCE in Rothman [21], and Bickel and Levin’a thresholding estimator in Bickel and Levin’a [19]).For CVaR item, Rockafeller and Uryasev [25, 26] calculate CVaR through a convex programming problem, which pave the way of portfolio selection with CVaR under nonnormal assumption. Bassett et al. [27] bridge the gap between quantile regression and calculation of CVaR without distribution assumption of returns. However, it has also been investigated that the out-of-sample performance is unstable in mean-CVaR model (see Lim et al. [28], Takeda and Kanamori [29], and Kondor et al. [30] for more details). A popular way to make mean-CVaR model stable is regularization technique which can lead to a sparse portfolio simultaneously. Xu et al. [7] incorporate penalty function into mean-CVaR model under the large scale sample scenarios to get a sparse portfolio. Gao and Wu [31] combine penalty function and variance item to improve the out-of-sample performance of mean-CVaR model. Additionally, regularization method has wide applications in constructing mean-variance model to find stable optimal portfolios with better out-of-sample performance. For example, Brodie et al. [32] reformulate classical Markowitz’s mean-variance model as a constrained least-squares regression problem. They add a L1-regularization term to the objective function and show that this penalty regularizes the optimization problem and encourages sparse portfolios. Other works about regularization technique used in mean-variance or mean-CVaR model to promote stable solutions can be seen in literatures (e.g., Gotoh and Takeda [33] and Fastrich et al. [34]).Motivated by the above discussion, in this paper, we try to find portfolios with more stable out-of-sample performance for mean-variance-CVaR model under high-dimensional scenarios. Five progressive optimization problems are designed carefully based on mean-variance-CVaR criteria through combining two estimators for covariance matrix, two computing methods for CVaR, and two penalty functions in different ways. Simulation is conducted to compare the out-of-sample performance of portfolios obtained from these optimization problems and the impact of underlying methods on optimal strategy is analyzed. Based on the historical data from the constituent stocks in Shanghai Stock Exchange 50 Index, an empirical study is considered.The remaining of this paper is organized as follows. Section2 describes the related methods used in this paper. Section 3 shows the optimization problems we formulate based on the mean-variance-CVaR criterion. Section 4 provides simulation and result comparisons. An empirical study is carried out in Section 5. Finally, Section 6 concludes the paper.


## 2. Methods

In this section, we will briefly introduce risk measures used in this paper, their estimating methods, and some regularization methods. Suppose that we have the opportunity to invest inp assets with returns Xk, k=1,2,…,p. Let X=X1,X2,…,Xp′ represent return vector with weight vector β=β1,β2,…,βp′, in which βk is the portfolio allocation weight for Xk. Thus, the total return is Y=X′β.


### 2.1. Variance

Variance describes the degree of dispersion of a random variable and hence can measure the fluctuation of investment return. Here, we useVX′β to denote the variance of a portfolio return variable Y since Y=X′β, and VX′β can be expressed as(1)VX′β=∑k=1p∑j=1pβkβjσkj=β′Σβ,where Σ=σkjp×p is the covariance matrix of X and σkj is the covariance of Xk and Xj.Generally,Σ is estimated by sample covariance matrix (called as classical estimator); that is, Σ^c=σ^kjp×p and σ^kj=1/n−1∑i=1nxki−x¯kxji−x¯j denote the sample covariance of Xk and Xj, where n is the sample size.Since the well-conditioned and sparse estimator proposed by Maurya [23], noted as Σ^w, has been proved its superiority of property. Therefore, in this paper, we employ the well-conditioned and sparse estimator Σ^w directly. Following the notation in Maurya [23], we have(2)Σ^wλ1,τ1=argminΣ=ΣTΣ−Σ^c22+λ1Σ−1+τ1∑k=1pσiΣ−σ¯Σ2,where Σ−=Σ−Σ+ and Σ+ denote a diagonal matrix with the same diagonal as Σ, σiΣ is the ith largest eigenvalue of matrix Σ, and σ¯Σ is the mean of eigenvalues of Σ, and the way to identify the best pair λ1,τ1 can also be found in Maurya [23].


### 2.2. CVaR

For financial assets or portfolio, VaR refers to the greatest possible loss over specific holding period, at a certain confidence level1001−α%,α∈0,1. If the cumulative distribution function for return Y is F, VaR can be defined as(3)VaR1−α=−F−1α.As we know, compared with VaR, a key advantage of CVaR is that CVaR satisfies the four coherence axioms of Artzner et al. [35], whereas VaR is not coherent. The definition of CVaR is as follows:(4)CVaR1−α=E−Y−Y≥VaR1−α.Evidently,CVaR1−α, the conditional expectation of losses exceeding VaR1−α, is more informative about the tail of the distribution than VaR1−α. Two popular ways to compute CVaR without distribution constraints have been employed recently. The first one is a linear programming model for optimizing CVaR proposed by Rockafellar and Uryasev [25, 26], generally called as Rockafellar–Uryasev’s approximation. They have proved that CVaR can be calculated by solving a convex optimization problem. In other words, CVaR can be formulated as(5)CVaR1−α1=minβ,ξξ+α−1E−X′β−ξ+,where ξ is the αth quantile of Y. This method has been widely used in many literatures (e.g., Roman et al. [12], Lim et al. [28], and Gao and Wu [31]).The second way is quantile regression method proposed in Bassett et al. [27]. Xu et al. [7] have proved that it has faster computational speed compared with Rockafellar–Uryasev’s approximation method. According to Bassett et al. [27], the CVaR of a portfolio return Y could be calculated by(6)CVaR1−α2=α−1minξEραY−ξ−EY,where ξ is the αth quantile of Y and ραu=uα−Iu<0 is the check function, in which I⋅ is an indicator function that takes on the value one whenever its argument is true and zero otherwise.SinceY=X′β, we can have Y=X1−∑j=2pX1−Xjβj under the constraint 1′β=1. Let Xj˜=X1−Xjj=2,3,…,p, we can convert equation (6) into(7)CVaR1−α2=α−1minβ,ξEραX1−∑j=2pXj˜βj−ξ−EX′β.


### 2.3. Regularization Method

To encourage a stable and sparse solution in optimization problem, penalty itemPen⋅ is frequently used, which is regarded as regularization method. Pen⋅ is a general penalty function that allows shrinking the components in β to zero. In this paper, we focus on smoothly clipped absolute deviation (SCAD) penalty proposed by Fan et al. [36] and reweighted L1 norm penalty proposed by Emmanuel et al. [37], since they have oracle properties.The SCAD penalty is formulated as follows:(8)λ∑k=1pPen1βk=∑k=1pλβkIβk≤λ+−βk2+2ζλβk−λ22ζ−1Iλ<βk≤ζλ+ζ+1λ22Iβk>ζλ,where ζζ<2 and λ are tuning parameters. It is well known that SCAD is continuous and singular at the origin, penalizes large coefficients equally, and has no bias, and the reweighted L1 norm is as follows:(9)λ∑k=1pPen2βk=λ∑k=1pωkβk,where λ is a tuning parameters and the value of ωk can be identified by iteration method based on the value of βk. Reweighed L1 norm has a better out-of-sample performance compared with L1 norm penalty [34], since it gives every component in β a corresponding weight so that the penalization is more accurate.


## 2.1. Variance

Variance describes the degree of dispersion of a random variable and hence can measure the fluctuation of investment return. Here, we useVX′β to denote the variance of a portfolio return variable Y since Y=X′β, and VX′β can be expressed as(1)VX′β=∑k=1p∑j=1pβkβjσkj=β′Σβ,where Σ=σkjp×p is the covariance matrix of X and σkj is the covariance of Xk and Xj.Generally,Σ is estimated by sample covariance matrix (called as classical estimator); that is, Σ^c=σ^kjp×p and σ^kj=1/n−1∑i=1nxki−x¯kxji−x¯j denote the sample covariance of Xk and Xj, where n is the sample size.Since the well-conditioned and sparse estimator proposed by Maurya [23], noted as Σ^w, has been proved its superiority of property. Therefore, in this paper, we employ the well-conditioned and sparse estimator Σ^w directly. Following the notation in Maurya [23], we have(2)Σ^wλ1,τ1=argminΣ=ΣTΣ−Σ^c22+λ1Σ−1+τ1∑k=1pσiΣ−σ¯Σ2,where Σ−=Σ−Σ+ and Σ+ denote a diagonal matrix with the same diagonal as Σ, σiΣ is the ith largest eigenvalue of matrix Σ, and σ¯Σ is the mean of eigenvalues of Σ, and the way to identify the best pair λ1,τ1 can also be found in Maurya [23].


## 2.2. CVaR

For financial assets or portfolio, VaR refers to the greatest possible loss over specific holding period, at a certain confidence level1001−α%,α∈0,1. If the cumulative distribution function for return Y is F, VaR can be defined as(3)VaR1−α=−F−1α.As we know, compared with VaR, a key advantage of CVaR is that CVaR satisfies the four coherence axioms of Artzner et al. [35], whereas VaR is not coherent. The definition of CVaR is as follows:(4)CVaR1−α=E−Y−Y≥VaR1−α.Evidently,CVaR1−α, the conditional expectation of losses exceeding VaR1−α, is more informative about the tail of the distribution than VaR1−α. Two popular ways to compute CVaR without distribution constraints have been employed recently. The first one is a linear programming model for optimizing CVaR proposed by Rockafellar and Uryasev [25, 26], generally called as Rockafellar–Uryasev’s approximation. They have proved that CVaR can be calculated by solving a convex optimization problem. In other words, CVaR can be formulated as(5)CVaR1−α1=minβ,ξξ+α−1E−X′β−ξ+,where ξ is the αth quantile of Y. This method has been widely used in many literatures (e.g., Roman et al. [12], Lim et al. [28], and Gao and Wu [31]).The second way is quantile regression method proposed in Bassett et al. [27]. Xu et al. [7] have proved that it has faster computational speed compared with Rockafellar–Uryasev’s approximation method. According to Bassett et al. [27], the CVaR of a portfolio return Y could be calculated by(6)CVaR1−α2=α−1minξEραY−ξ−EY,where ξ is the αth quantile of Y and ραu=uα−Iu<0 is the check function, in which I⋅ is an indicator function that takes on the value one whenever its argument is true and zero otherwise.SinceY=X′β, we can have Y=X1−∑j=2pX1−Xjβj under the constraint 1′β=1. Let Xj˜=X1−Xjj=2,3,…,p, we can convert equation (6) into(7)CVaR1−α2=α−1minβ,ξEραX1−∑j=2pXj˜βj−ξ−EX′β.


## 2.3. Regularization Method

To encourage a stable and sparse solution in optimization problem, penalty itemPen⋅ is frequently used, which is regarded as regularization method. Pen⋅ is a general penalty function that allows shrinking the components in β to zero. In this paper, we focus on smoothly clipped absolute deviation (SCAD) penalty proposed by Fan et al. [36] and reweighted L1 norm penalty proposed by Emmanuel et al. [37], since they have oracle properties.The SCAD penalty is formulated as follows:(8)λ∑k=1pPen1βk=∑k=1pλβkIβk≤λ+−βk2+2ζλβk−λ22ζ−1Iλ<βk≤ζλ+ζ+1λ22Iβk>ζλ,where ζζ<2 and λ are tuning parameters. It is well known that SCAD is continuous and singular at the origin, penalizes large coefficients equally, and has no bias, and the reweighted L1 norm is as follows:(9)λ∑k=1pPen2βk=λ∑k=1pωkβk,where λ is a tuning parameters and the value of ωk can be identified by iteration method based on the value of βk. Reweighed L1 norm has a better out-of-sample performance compared with L1 norm penalty [34], since it gives every component in β a corresponding weight so that the penalization is more accurate.


## 3. Model Formation

Motivated by Roman et al. [12], we consider the following mean-variance-CVaR model:(10)Pmvc:minβηVX′β+1−ηCVaR1−αs.t.1′β=1EX′β=μ0,where 0≤η≤1 is a weighting parameter, which represents the attitude that investors hold towards the two risk measures and hence balances the importance of them.Remark 1.
Lettingη=0 or η=1, respectively, the above optimization problem is reduced to the mean-CVaR model or mean-variance model.Remark 2.
Different from Roman et al. [12], in this paper, we incorporate the variance term and CVaR term into the objective function of optimization model simultaneously and short selling is allowed.


### 3.1. Optimization Problems

In this section, we present the following five optimization problems based on different methods of calculating variance, CVaR, and different regularization methods in order to obtain optimal portfolio forPmvc.To illustrate clearly, we outline the optimization problems in Table1. Here, ”√” means the underlying method is incorporated in the corresponding optimization problem. For example, the second row tells us that the classical estimation Σ^c of variance term and Rockafellar–Uryasev’s approximation CVaR1−α1 for CVaR term are used in problem P1.Table 1
Methods in optimization problems.
Σ^cΣ^wCVaR1−α1CVaR1−α2Pen1Pen2P1√√P2√√P3√√P4√√√P5√√√Mathematically, optimization problems can be written in the following forms:(11)P1:minβ,ξηβ′Σ^cβ+1−ηξ+α−1E−X′β−ξ+s.t.1′β=1EX′β=μ0,P2:minβ,ξηβ′Σ^wβ+1−ηξ+α−1E−X′β−ξ+s.t.1′β=1EX′β=μ0,P3:minβ,ξηβ′Σ^wβ+1−ηα−1EραX1−∑j=2pXj˜βj−ξs.t.EX′β=μ0,P4:minβ,ξηβ′Σ^wβ+1−ηα−1EραX1−∑j=2pXj˜βj−ξ+λ∑i=1pPen1βis.t.EX′β=μ0,P5:minβ,ξηβ′Σ^wβ+1−ηα−1EραX1−∑j=2pXj˜βj−ξ+λ∑i=1pPen2βis.t.EX′β=μ0.Why do we design such five optimization problems in the foregoing way? InP1, the classical method of variance term and Rockafellar–Uryasev’s approximation for CVaR term are used to find the solution. To construct P2, we replace the classical estimator Σ^c in the variance term in P1 with Σ^w, and the CVaR part remains the same so that we could find if Σ^w could mitigate the instability. Further, we replace CVaR1−α1 in P2 with CVaR1−α2 to get P3, so that the difference between the two computational methods for CVaR could be compared. In P3−P5, 1′β=1 can be absorbed into the CVaR item based on quantile regression method. To examine the performance of SCAD and reweighted L1 norm penalty function, we design P4 and P5, in which quantile computational method for CVaR is used because of the convenience of selecting tuning parameter in penalty function and faster computational speed [7]. Through such progressive problem design, we can figure out the performance of different methods and find the most effective one in our setting.Remark 3.
The estimation methods used inP1 for variance and CVaR are the same as that in Roman et al. [12].Remark 4.
Ifη=0, P4 degenerates into the model in Xu et al. [7]. However, the constraint EX′β=μ0 is missing in their paper. According to Bassett et al. [27], the EX′β item in CVaR part (see (7)) in objective function can be neglected only under the constraint that the expected return of portfolio is a constant.


### 3.2. Selection of Tuning Parameter

ForP4 and P5, we need to search the best tuning parameter for penalty item.InP4, the nonnegative regularization parameter λ drives the relevance of the SCAD penalty and ζ is a tuning parameter belonging to SCAD penalty. Here, we search the best pair θ=λ,ζ′ over two-dimension grids following the criterion mentioned in the following. Motivated by Lee et al. [38] and Wang et al. [39], we use the modified Bayesian Information Criterion as follows:(12)θ^=argminθlnη⋅β^Σ^wβ^+1−ηα−1∑i=1nραxi,1−∑j=2px˜i,jβ^j,θ−ξ^θ+df⋅lnn2n⋅lnp,where x1,1,x2,1,…,xn,1 are random samples of X1, x˜1,j,x˜2,j,…,x˜n,j are random samples of X˜j for j=2,3,…,p, and df is the effective dimension of fitting model. Additionally, df=ℰ indicates the number of points in the set ℰ with ℰ=j:β^j,θ≠0,2≤j≤p. Furthermore, the iterative algorithm for conducting P4 can be seen in Wu and Liu [40].InP5, λ is the nonnegative regularization parameter and ωk,k=1,2,…,p is the tuning parameter in reweighted L1 norm penalty. For ω=ω1,ω2,…,ωp′, we apply the following iterative procedure for every given λ to change the weighting parameter ωk dynamically and adaptively [37].(1)
Let the iteration count beh. For any given ωh, we solve the problem P5, which gives the solution β^h. If the stopping criteria are satisfied, for example, compared with every component in β^h−1, the maximum change does not exceed some small constant, we stop the iteration. Otherwise, go to Step (2).(2)
Useβ^h to construct the new weighting parameter ωkh+1=1/β^kh+ε, where ε can be a small positive number and let h=h+1. Go to Step (1).Finally, here,θ=λ,ω1,ω2,…,ωp′ can be searched by iteration based on the modified Bayesian Information Criterion equation (12).


## 3.1. Optimization Problems

In this section, we present the following five optimization problems based on different methods of calculating variance, CVaR, and different regularization methods in order to obtain optimal portfolio forPmvc.To illustrate clearly, we outline the optimization problems in Table1. Here, ”√” means the underlying method is incorporated in the corresponding optimization problem. For example, the second row tells us that the classical estimation Σ^c of variance term and Rockafellar–Uryasev’s approximation CVaR1−α1 for CVaR term are used in problem P1.Table 1
Methods in optimization problems.
Σ^cΣ^wCVaR1−α1CVaR1−α2Pen1Pen2P1√√P2√√P3√√P4√√√P5√√√Mathematically, optimization problems can be written in the following forms:(11)P1:minβ,ξηβ′Σ^cβ+1−ηξ+α−1E−X′β−ξ+s.t.1′β=1EX′β=μ0,P2:minβ,ξηβ′Σ^wβ+1−ηξ+α−1E−X′β−ξ+s.t.1′β=1EX′β=μ0,P3:minβ,ξηβ′Σ^wβ+1−ηα−1EραX1−∑j=2pXj˜βj−ξs.t.EX′β=μ0,P4:minβ,ξηβ′Σ^wβ+1−ηα−1EραX1−∑j=2pXj˜βj−ξ+λ∑i=1pPen1βis.t.EX′β=μ0,P5:minβ,ξηβ′Σ^wβ+1−ηα−1EραX1−∑j=2pXj˜βj−ξ+λ∑i=1pPen2βis.t.EX′β=μ0.Why do we design such five optimization problems in the foregoing way? InP1, the classical method of variance term and Rockafellar–Uryasev’s approximation for CVaR term are used to find the solution. To construct P2, we replace the classical estimator Σ^c in the variance term in P1 with Σ^w, and the CVaR part remains the same so that we could find if Σ^w could mitigate the instability. Further, we replace CVaR1−α1 in P2 with CVaR1−α2 to get P3, so that the difference between the two computational methods for CVaR could be compared. In P3−P5, 1′β=1 can be absorbed into the CVaR item based on quantile regression method. To examine the performance of SCAD and reweighted L1 norm penalty function, we design P4 and P5, in which quantile computational method for CVaR is used because of the convenience of selecting tuning parameter in penalty function and faster computational speed [7]. Through such progressive problem design, we can figure out the performance of different methods and find the most effective one in our setting.Remark 3.
The estimation methods used inP1 for variance and CVaR are the same as that in Roman et al. [12].Remark 4.
Ifη=0, P4 degenerates into the model in Xu et al. [7]. However, the constraint EX′β=μ0 is missing in their paper. According to Bassett et al. [27], the EX′β item in CVaR part (see (7)) in objective function can be neglected only under the constraint that the expected return of portfolio is a constant.


## 3.2. Selection of Tuning Parameter

ForP4 and P5, we need to search the best tuning parameter for penalty item.InP4, the nonnegative regularization parameter λ drives the relevance of the SCAD penalty and ζ is a tuning parameter belonging to SCAD penalty. Here, we search the best pair θ=λ,ζ′ over two-dimension grids following the criterion mentioned in the following. Motivated by Lee et al. [38] and Wang et al. [39], we use the modified Bayesian Information Criterion as follows:(12)θ^=argminθlnη⋅β^Σ^wβ^+1−ηα−1∑i=1nραxi,1−∑j=2px˜i,jβ^j,θ−ξ^θ+df⋅lnn2n⋅lnp,where x1,1,x2,1,…,xn,1 are random samples of X1, x˜1,j,x˜2,j,…,x˜n,j are random samples of X˜j for j=2,3,…,p, and df is the effective dimension of fitting model. Additionally, df=ℰ indicates the number of points in the set ℰ with ℰ=j:β^j,θ≠0,2≤j≤p. Furthermore, the iterative algorithm for conducting P4 can be seen in Wu and Liu [40].InP5, λ is the nonnegative regularization parameter and ωk,k=1,2,…,p is the tuning parameter in reweighted L1 norm penalty. For ω=ω1,ω2,…,ωp′, we apply the following iterative procedure for every given λ to change the weighting parameter ωk dynamically and adaptively [37].(1)
Let the iteration count beh. For any given ωh, we solve the problem P5, which gives the solution β^h. If the stopping criteria are satisfied, for example, compared with every component in β^h−1, the maximum change does not exceed some small constant, we stop the iteration. Otherwise, go to Step (2).(2)
Useβ^h to construct the new weighting parameter ωkh+1=1/β^kh+ε, where ε can be a small positive number and let h=h+1. Go to Step (1).Finally, here,θ=λ,ω1,ω2,…,ωp′ can be searched by iteration based on the modified Bayesian Information Criterion equation (12).


## 4. Simulation and Discussion

### 4.1. Data Generation

To evaluate the out-of-sample performance of these five portfolio optimization problems, the dataset is generated by simulation approach with parameters being estimated from real historical price data of stock index.


#### 4.1.1. Construction of Return Variable

Following the idea in Lim et al. [28], the random returns are captured by a hybrid distribution with multivariate normal distribution and exponential distribution. So all assets might suffer a perfectly correlated exponential-tail loss in a small probability. Let z be the exponential random variable with parameter q and we set q=10 for simplicity. So the return variable is constructed as follows:(13)X∼Bτz1+c+1−BτN,where Bτ is the Bernoulli random variable with parameter τ, N follows multivariate normal distribution with mean vector μ˜ and covariance matrix Σ˜, and c=c1,c2,…,cp′ with ck=μ˜k−Σ˜kk/2, where Σ˜kk is the k-th diagonal element of the matrix Σ˜. The parameter τ controls the tail loss of the distribution.


#### 4.1.2. Determination of Parameter Values

We choose 142 stocks which in Shanghai Stock Exchange Constituent (SSEC) index download the data from Joinquant Data platform. The sample period spans from Jan 3, 2015, to Dec 31, 2015. We calculate the daily yield return and estimate their mean return vectorμ˜=μ1,μ2,…,μp′ and covariance matrix Σ˜. (Note that the 180 constituent stocks in SSEC are always changing in the sample period, since the sample is adjusted every half year; therefore, we choose 142 stocks which continuously stay in the index over the period.)


#### 4.1.3. Data Generation

As we know, when the dimensionality of assets is comparable to the number of observations, the data set belongs to high-dimensional scenarios. Therefore, in order to simulate a high-dimensional data set, we set the size ofn close to p=142. Letting n=150 and τ=0.05, we simulate 101 groups of data, one group as in-sample data, and 100 group as out-of-sample data.


### 4.2. Optimization Results

In this section, we will calculate simulation results based on the five optimization problems, respectively, and give the comparisons from the point view of the out-of-sample performance. Without loss of generality, we setμ0=0.01. All the calculations follow three steps:Step 1: calculate the weight of assets in portfolio selection model with differentη= 0, 0.25, 0.5, 0.75, and 1 for in-sample data.Step 2: based on the weights in Step 1, we calculate the variance, CVaR with 0.95 confidence level, and expected return for other 100 groups of out-of-sample data.Step 3: summarize their mean value and standard deviation for every case. For example, under the case ofP1 at η=1, the mean value and the standard deviation for 100 values of CVaR are calculated to be 10.0812 and (0.9708), respectively.Steps 1 and 2 mean that we hold the optimal portfolio generated from in-sample data in the out-of-sample period, in which the data follow the same distribution as in-sample data. Therefore, if the optimal portfolio is stable, the performance of portfolio in 100 groups of out-of-sample data should be similar, and hence, we calculate the standard deviation in Step 3 to measure the similarity of the performance in 100 groups.The results are shown in Table2.Table 2
Out-of-sample performance ofP1–P5.
η=1η=0.75η=0.5η=0.25η=0P1Variance5.02354.60444.38214.28974.9986(0.3525)(0.3281)(0.3163)(0.3111)(0.3121)CVaR10.08129.21108.72808.52449.9947(0.9708)(0.9307)(0.9299)(0.9324)(0.9786)Exp return0.23890.20760.19960.22050.31(0.4227)(0.3950)(0.3855)(0.3894)(0.4571)P2Variance1.34051.59781.91412.37835.1578(0.1919)(0.2613)(0.3365)(0.4369)(0.9564)CVaR2.59833.05913.65414.57529.9947(0.2618)(0.3213)(0.3635)(0.4496)(0.9786)Exp return0.19390.18170.19740.16900.31(0.1226)(0.1438)0.1729)(0.2176)(0.4571)P3Variance1.34051.59781.91412.37835.1578(0.1919)(0.2613)(0.3365)(0.4369)(0.9564)CVaR2.59833.05913.65414.57529.9947(0.2618)(0.3213)(0.3635)(0.4496)(0.9786)Exp return0.19390.18170.19740.16900.31(0.1226)(0.1438)(0.1729)(0.2176)(0.4571)P4Variance1.17581.19341.22321.27821.2769(0.0837)(0.0815)(0.0795)(0.0802)(0.0764)CVaR2.47392.49972.54012.65872.6631(0.25(0.2670)(0.2751)(0.2882)(0.2867)Exp return0.07720.08160.09250.09620.0917(0.1092)(0.1112)(0.1148)(0.1215)(0.1199)P5Variance1.12231.16321.18301.20941.2274(0.0769)(0.0769)(0.0744)(0.0738)(0.0705)CVaR2.33342.41512.43952.49562.5304(0.2407)(0.2570)(0.2625)(0.2770)(0.2750)Exp return0.084990.08520.09170.09560.0976(0.1026)(0.1071)(0.1092)(0.1142)(0.1145)From Table2, the following results are concluded:(1)
ComparedP1 with P2–P5, the mean for 100 values of variance, CVaR in P1 are larger, which means that the risks of portfolios in out-of-sample data get out of control and the expected returns are also higher. This is consistent with the truth of “high risk; high return.” The inherent reason is that sample covariance estimator lost its theoretical support (Law of Large Numbers) in high-dimensional scenarios.(2)
ComparedP2 with P1, we can find that all the counterparts in P2 decrease, which tells that the use of well-conditioned and sparse estimator (Σ^w) could control the risk significantly and improves the stability of solutions’ out-of-sample performance as well. When η=0, the model is reduced to mean-CVaR model, whose solution is irrelevant to the estimation of Σ, so the values of CVaR and expected return should remain the same. The data in Table 2 really illustrate this fact.(3)
The results inP2 and P3 share identical in-sample optimal portfolio values and out-of-sample performance. This means that the impact of Rockafellar–Uryasev’s approximation and quantile regression method of CVaR on the solution of optimization problem shows no significant difference under our setting.(4)
The values inP4 further become smaller than ones in P3, which says that the use of SCAD penalty technique can improve the stability and the risk-controlling ability for out-of-sample performance.(5)
ComparedP5 with P4, the values of variance and CVaR in P5 show a slight decrease, which means that the reweighted L1 norm penalty contributes to a more stable out-of-sample performance than SCAD penalty, even though the improvement is fractional.(6)
Biggerη represents a higher proportion for variance item in objective function. Since variance is a more conservative risk measure compared with CVaR, generally, bigger η results in a more conservative portfolio with relative low-risk index and expected return in out-of-sample analysis. The values in P4 and P5 show this trend well. But others fail, which may attribute to the instable out-of-sample performance.To analyze the stability of out-of-sample performance inP1–P5 easily, we draw the scatter diagram for each optimization problem at η=0.5. For the convenience of comparison, we give the following graphical design. First, P1, P2, and P3 share the same coordinate system (see Figure 1), and the diagrams of P2 and P3 are identical, so we draw them in one diagram. Second, to give a vivid comparison, we zoom in the coordinate scale and draw the diagrams of P3 and P4; see Figure 2. The coordinate scale is further amplified in Figure 3 for the diagrams of P4 and P5.Figure 1
Out-of-sample performance ofP1–P3 (η=0.5). (a) Performance of P1; (b) performance of P2 or P3.
(a)(b)Figure 2
Out-of-sample performance ofP3–P4 (η=0.5). (a) Performance of P3; (b) performance of P4.
(a)(b)Figure 3
Out-of-sample performance ofP4–P5 (η=0.5). (a) Performance of P4; (b) performance of P5.
(a)(b)From Figure1, we can find that the points in (b) are in lower risk positions and more concentrative, which means that the portfolio generated from P2 (or P3) has a better risk-controlling ability and more similar performance in 100 groups of out-of-sample data sets. Thus, the well-conditioned and sparse estimator Σ^w helps to stabilize the out-of-sample performance and control the risk better. This is consistent with result (2) from Table 2.From Figures2 and 3, we can conclude that penalty items also help to stabilize the out-of-sample performance significantly and the reweighted L1 norm penalty performs a little bit better than SCAD penalty under our settings. This is consistent with results (4) and (5) from Table 2.


## 4.1. Data Generation

To evaluate the out-of-sample performance of these five portfolio optimization problems, the dataset is generated by simulation approach with parameters being estimated from real historical price data of stock index.


### 4.1.1. Construction of Return Variable

Following the idea in Lim et al. [28], the random returns are captured by a hybrid distribution with multivariate normal distribution and exponential distribution. So all assets might suffer a perfectly correlated exponential-tail loss in a small probability. Let z be the exponential random variable with parameter q and we set q=10 for simplicity. So the return variable is constructed as follows:(13)X∼Bτz1+c+1−BτN,where Bτ is the Bernoulli random variable with parameter τ, N follows multivariate normal distribution with mean vector μ˜ and covariance matrix Σ˜, and c=c1,c2,…,cp′ with ck=μ˜k−Σ˜kk/2, where Σ˜kk is the k-th diagonal element of the matrix Σ˜. The parameter τ controls the tail loss of the distribution.


### 4.1.2. Determination of Parameter Values

We choose 142 stocks which in Shanghai Stock Exchange Constituent (SSEC) index download the data from Joinquant Data platform. The sample period spans from Jan 3, 2015, to Dec 31, 2015. We calculate the daily yield return and estimate their mean return vectorμ˜=μ1,μ2,…,μp′ and covariance matrix Σ˜. (Note that the 180 constituent stocks in SSEC are always changing in the sample period, since the sample is adjusted every half year; therefore, we choose 142 stocks which continuously stay in the index over the period.)


### 4.1.3. Data Generation

As we know, when the dimensionality of assets is comparable to the number of observations, the data set belongs to high-dimensional scenarios. Therefore, in order to simulate a high-dimensional data set, we set the size ofn close to p=142. Letting n=150 and τ=0.05, we simulate 101 groups of data, one group as in-sample data, and 100 group as out-of-sample data.


## 4.1.1. Construction of Return Variable

Following the idea in Lim et al. [28], the random returns are captured by a hybrid distribution with multivariate normal distribution and exponential distribution. So all assets might suffer a perfectly correlated exponential-tail loss in a small probability. Let z be the exponential random variable with parameter q and we set q=10 for simplicity. So the return variable is constructed as follows:(13)X∼Bτz1+c+1−BτN,where Bτ is the Bernoulli random variable with parameter τ, N follows multivariate normal distribution with mean vector μ˜ and covariance matrix Σ˜, and c=c1,c2,…,cp′ with ck=μ˜k−Σ˜kk/2, where Σ˜kk is the k-th diagonal element of the matrix Σ˜. The parameter τ controls the tail loss of the distribution.


## 4.1.2. Determination of Parameter Values

We choose 142 stocks which in Shanghai Stock Exchange Constituent (SSEC) index download the data from Joinquant Data platform. The sample period spans from Jan 3, 2015, to Dec 31, 2015. We calculate the daily yield return and estimate their mean return vectorμ˜=μ1,μ2,…,μp′ and covariance matrix Σ˜. (Note that the 180 constituent stocks in SSEC are always changing in the sample period, since the sample is adjusted every half year; therefore, we choose 142 stocks which continuously stay in the index over the period.)


## 4.1.3. Data Generation

As we know, when the dimensionality of assets is comparable to the number of observations, the data set belongs to high-dimensional scenarios. Therefore, in order to simulate a high-dimensional data set, we set the size ofn close to p=142. Letting n=150 and τ=0.05, we simulate 101 groups of data, one group as in-sample data, and 100 group as out-of-sample data.


## 4.2. Optimization Results

In this section, we will calculate simulation results based on the five optimization problems, respectively, and give the comparisons from the point view of the out-of-sample performance. Without loss of generality, we setμ0=0.01. All the calculations follow three steps:Step 1: calculate the weight of assets in portfolio selection model with differentη= 0, 0.25, 0.5, 0.75, and 1 for in-sample data.Step 2: based on the weights in Step 1, we calculate the variance, CVaR with 0.95 confidence level, and expected return for other 100 groups of out-of-sample data.Step 3: summarize their mean value and standard deviation for every case. For example, under the case ofP1 at η=1, the mean value and the standard deviation for 100 values of CVaR are calculated to be 10.0812 and (0.9708), respectively.Steps 1 and 2 mean that we hold the optimal portfolio generated from in-sample data in the out-of-sample period, in which the data follow the same distribution as in-sample data. Therefore, if the optimal portfolio is stable, the performance of portfolio in 100 groups of out-of-sample data should be similar, and hence, we calculate the standard deviation in Step 3 to measure the similarity of the performance in 100 groups.The results are shown in Table2.Table 2
Out-of-sample performance ofP1–P5.
η=1η=0.75η=0.5η=0.25η=0P1Variance5.02354.60444.38214.28974.9986(0.3525)(0.3281)(0.3163)(0.3111)(0.3121)CVaR10.08129.21108.72808.52449.9947(0.9708)(0.9307)(0.9299)(0.9324)(0.9786)Exp return0.23890.20760.19960.22050.31(0.4227)(0.3950)(0.3855)(0.3894)(0.4571)P2Variance1.34051.59781.91412.37835.1578(0.1919)(0.2613)(0.3365)(0.4369)(0.9564)CVaR2.59833.05913.65414.57529.9947(0.2618)(0.3213)(0.3635)(0.4496)(0.9786)Exp return0.19390.18170.19740.16900.31(0.1226)(0.1438)0.1729)(0.2176)(0.4571)P3Variance1.34051.59781.91412.37835.1578(0.1919)(0.2613)(0.3365)(0.4369)(0.9564)CVaR2.59833.05913.65414.57529.9947(0.2618)(0.3213)(0.3635)(0.4496)(0.9786)Exp return0.19390.18170.19740.16900.31(0.1226)(0.1438)(0.1729)(0.2176)(0.4571)P4Variance1.17581.19341.22321.27821.2769(0.0837)(0.0815)(0.0795)(0.0802)(0.0764)CVaR2.47392.49972.54012.65872.6631(0.25(0.2670)(0.2751)(0.2882)(0.2867)Exp return0.07720.08160.09250.09620.0917(0.1092)(0.1112)(0.1148)(0.1215)(0.1199)P5Variance1.12231.16321.18301.20941.2274(0.0769)(0.0769)(0.0744)(0.0738)(0.0705)CVaR2.33342.41512.43952.49562.5304(0.2407)(0.2570)(0.2625)(0.2770)(0.2750)Exp return0.084990.08520.09170.09560.0976(0.1026)(0.1071)(0.1092)(0.1142)(0.1145)From Table2, the following results are concluded:(1)
ComparedP1 with P2–P5, the mean for 100 values of variance, CVaR in P1 are larger, which means that the risks of portfolios in out-of-sample data get out of control and the expected returns are also higher. This is consistent with the truth of “high risk; high return.” The inherent reason is that sample covariance estimator lost its theoretical support (Law of Large Numbers) in high-dimensional scenarios.(2)
ComparedP2 with P1, we can find that all the counterparts in P2 decrease, which tells that the use of well-conditioned and sparse estimator (Σ^w) could control the risk significantly and improves the stability of solutions’ out-of-sample performance as well. When η=0, the model is reduced to mean-CVaR model, whose solution is irrelevant to the estimation of Σ, so the values of CVaR and expected return should remain the same. The data in Table 2 really illustrate this fact.(3)
The results inP2 and P3 share identical in-sample optimal portfolio values and out-of-sample performance. This means that the impact of Rockafellar–Uryasev’s approximation and quantile regression method of CVaR on the solution of optimization problem shows no significant difference under our setting.(4)
The values inP4 further become smaller than ones in P3, which says that the use of SCAD penalty technique can improve the stability and the risk-controlling ability for out-of-sample performance.(5)
ComparedP5 with P4, the values of variance and CVaR in P5 show a slight decrease, which means that the reweighted L1 norm penalty contributes to a more stable out-of-sample performance than SCAD penalty, even though the improvement is fractional.(6)
Biggerη represents a higher proportion for variance item in objective function. Since variance is a more conservative risk measure compared with CVaR, generally, bigger η results in a more conservative portfolio with relative low-risk index and expected return in out-of-sample analysis. The values in P4 and P5 show this trend well. But others fail, which may attribute to the instable out-of-sample performance.To analyze the stability of out-of-sample performance inP1–P5 easily, we draw the scatter diagram for each optimization problem at η=0.5. For the convenience of comparison, we give the following graphical design. First, P1, P2, and P3 share the same coordinate system (see Figure 1), and the diagrams of P2 and P3 are identical, so we draw them in one diagram. Second, to give a vivid comparison, we zoom in the coordinate scale and draw the diagrams of P3 and P4; see Figure 2. The coordinate scale is further amplified in Figure 3 for the diagrams of P4 and P5.Figure 1
Out-of-sample performance ofP1–P3 (η=0.5). (a) Performance of P1; (b) performance of P2 or P3.
(a)(b)Figure 2
Out-of-sample performance ofP3–P4 (η=0.5). (a) Performance of P3; (b) performance of P4.
(a)(b)Figure 3
Out-of-sample performance ofP4–P5 (η=0.5). (a) Performance of P4; (b) performance of P5.
(a)(b)From Figure1, we can find that the points in (b) are in lower risk positions and more concentrative, which means that the portfolio generated from P2 (or P3) has a better risk-controlling ability and more similar performance in 100 groups of out-of-sample data sets. Thus, the well-conditioned and sparse estimator Σ^w helps to stabilize the out-of-sample performance and control the risk better. This is consistent with result (2) from Table 2.From Figures2 and 3, we can conclude that penalty items also help to stabilize the out-of-sample performance significantly and the reweighted L1 norm penalty performs a little bit better than SCAD penalty under our settings. This is consistent with results (4) and (5) from Table 2.


## 5. Empirical Study

Suppose that an investor intends to track a stock index in a financial market allowing short selling. Through the Joinquant Data platform, we select daily data of the constituent stocks in Shanghai Stock Exchange 50 (SSE 50) Index from Jun 11, 2018, to Dec 11, 2018. The reason why we choose data in a period of half a year elaborates as follows. The constituent stocks in SSE 50 change every half year or so, and keeping them as a group in an index apparently influences the dependency structure of assets, which further affects the optimal investment strategy. Therefore, when an investor intends to track SSE 50, it is reasonable to get the data in which the same 50 stocks always stay in SSE 50.Then, we tag the 50 stocks from No. 1 to No. 50. After calculating, we obtain 124 observations of daily logarithm yield return, including 64 in-sample data spanning from Jun 11, 2018, to Sept 10, 2018, and 60 out-of-sample data spanning from Sept 11, 2018, to Dec 11, 2018. Here, we can find that the dimensionality of in-sample data meets the requirement of high-dimensional scenarios becausep=50 and n=64 are comparable.SinceP5 outperforms P1–P4 from Section 4, we calculate the optimal portfolios based on P5 in formula (13) and show the results in Figure 4. The parameter η is supposed to be 0, 0.5, and 1, respectively, and the target return μ0 is set to be the average value of the return data of 50 stocks. Considering the idea in this paper is illuminated by the pioneering work of Roman et al. [12], we further conduct the corresponding analysis from P1 for comparison and the results are shown in Figure 5. It can be easily found that portfolios from P5 are much more sparse and can avoid extreme investment action, which will be more applicable to the practice of finance.Figure 4
Portfolio strategy ofP5 under different η. (a) Portfolio of P5 (η = 0), (b) portfolio of P5 (η = 0.5), and (c) portfolio of P5 (η = 1).
(a)(b)(c)Figure 5
Portfolio strategy ofP1 under different η. (a) Portfolio of P1 (η = 0), (b) portfolio of P1 (η = 0.5), and (c) portfolio of P1 (η = 1).
(a)(b)(c)Next, we observe the out-of-sample performance of the portfolios. There is evidence that equal weight (EW) strategy cannot be defeated by many portfolio methods consistently (DeMiguel et al. [17]). We also add EW strategy into comparison here. The variance, CVaR0.95, and average return of the portfolios are calculated, respectively; see Table 3. The accumulated returns of the portfolios in out-of-sample period are displayed in Figure 6.Table 3
Out-of-sample performance of portfolios.
η=0η=0.5η=1EWP1P5P1P5P1P5Variance3.6091.6743.3261.9373.1581.9862.787CVaR3.8362.9983.9983.2103.8273.1873.985Avg return0.0060.061−0.0590.075−0.0650.03800.017Figure 6
Accumulated return in out-of-sample period. (a) Different model withη = 0.5. (b) Model P5 with different η.
(a)(b)From Table3 and Figure 6(a), we can conclude that the portfolio generated from P5 has the highest terminal return and can control the risk robustly over the period, since it has a relatively slight fluctuation and avoids extreme losses and outperforms the EW strategy basically. However, the portfolio generated from P1 is unstable even compared with EW strategy and ends up with the lowest return in spite of being dominate at the beginning. Figure 6(b) also tells us that η=0.5 in P5 will have a more promising terminal return compared with the case only considering CVaR (η=0) or variance (η=1).


## 6. Conclusion

In this paper, we have constructed five progressive optimization problems to figure out a relatively better way to conduct mean-variance-CVaR portfolio selection model in high-dimension scenarios. Specifically, two covariance matrix estimators (classical estimator and well-conditioned and sparse estimator), two estimation methods for CVaR (Rockafellar–Uryasev’s approximation and quantile regression), and two penalty functions (SCAD and reweightedL1 norm) have been considered and different combinations of them have been used for the formulation of optimization problems. The data for simulation is generated from a hybrid distribution with multivariate normal distribution and exponential distribution. Moreover, the correlation matrix and mean vector of the multivariate normal distribution are estimated from real data. The simulation studies show that the well-conditioned and sparse estimator and penalty item devote to alleviate poor out-of-sample performance significantly and the reweighted L1 norm penalty has a slight superiority. Additionally, we find that the classical optimization methods for mean-variance-CVaR model in Roman et al. [12] may result in poor out-of-sample performance under high-dimension scenarios. An empirical study has been conducted based on the data of constituent stocks in SSE 50. The results solidify the foregoing findings. Therefore, we suggest to combine well-conditioned and sparse covariance estimator, quantile regression computational method for CVaR, and reweighted L1 norm for portfolio optimization under mean-variance-CVaR criterion, since the fragile out-of-sample performance could be effectively mitigated.The study in this paper focuses on the high-dimensional setting, wheren is just a little bit greater than p. An extension of this study under a more extremely high-dimensional scenario in which p>n would also be interesting. Moreover, it is noteworthy to further stabilize the out-of-sample performance by controlling the fragile brought by mean item. We will explore these problems in the following study.



---

*Source: 2767231-2020-07-15.xml*