# Photovoltaic Generation Prediction of CCIPCA Combined with LSTM

Authors: E. Zhu; D. Pi
Journal: Complexity
 (2020)

---

## Abstract

In order to remedy problems encompassing large-scale data being collected by photovoltaic (PV) stations, multiple dimensions of power prediction mode input, noise, slow model convergence speed, and poor precision, a power prediction model that combines the Candid Covariance-free Incremental Principal Component Analysis (CCIPCA) with Long Short-Term Memory (LSTM) network was proposed in this study. The corresponding model uses factor correlation coefficient to evaluate the factors that affect PV generation and obtains the most critical factor of PV generation. Then, it uses CCIPCA to reduce the dimension of PV super large-scale data to the factor dimension, avoiding the complex calculation of covariance matrix of algorithms such as Principal Component Analysis (PCA) and to some extent eliminating the influence of noise made by PV generation data acquisition equipment and transmission equipment such as sensors. The training speed and convergence speed of LSTM are improved by the dimension-reduced data. The PV generation data of a certain power station over a period is collected from SolarGIS as sample data. The model is compared with Markov chain power generation prediction model and GA-BP power generation prediction model. The experimental results indicate that the generation prediction error of the model is less than 3%.


---

## Body

## 1. Introduction

With the gradual implementation of the “Internet + energy” policy, the PV generation industry is rapidly developing. The proposed incorporation of artificial intelligence has instilled new incentives for the PV generation industry. PV generation is susceptible to influence from extreme weather, distorting the predicted results and adding trouble in dispatching when the power system is connected to the grid [1], which may even lead to power resource wastage. Numerous methods in artificial intelligence exist for photovoltaic generation prediction such as support vector machines [2], Markov chains [3], and neural networks. Neural networks are widely used in PV generation prediction, and a number of power generation prediction models have surfaced to this effect, including neural networks based on time series [4], GA-BP neural network [5], deep belief network [6], and fuzzy neural network [7]. Such models find it difficult to overcome issues in convergence and local optimization, and they suffer from large prediction errors, mainly because many network input compositions are present, along with noises in the sample data. Various scholars have used principal component analysis (PCA) [8] and other algorithms to preprocess the collected data; however, PCA and other algorithms find it difficult to process large amounts of data collected in real time due to their own defects. In view of the above problem, this paper adopted CCIPCA, which is suitable in analysing large data sets to extract key data affecting power generation prediction, to reduce dimensions in data and eliminate noise. Simultaneously, combined with LSTM [9], a power generation prediction model was established to overcome problems such as local convergence and slow training speed, controlling the prediction error of PV generation within 3%.


## 2. Relevant Works

### 2.1. Analysis of Correlation Factors in Power Generation Prediction

The sample data adopted the data of PV station no. 11282, Zhangdian District, Zibo City, Shandong Province, China, which was provided by SolarGIS. Its geographical location is 118 degrees east longitude and 32 degrees north latitude. The data includes total solar radiation data such as horizontal radiation GHI and normal direct radiation DNI and meteorological parameters like temperature, humidity, and pressure, as well as environmental parameters such as elevation, surface inclination angle, and surface azimuth angle. There were a total of 37 dimensions and 30 minutes of resolution.Considering that parameters like geographical location are constant and have little influence on power generation prediction, the prediction model will not be considered. Meteorological and historical power generation data were taken as the main influencing factors of the model, including power generation every 30 minutes, power generation at the moment in history, environmental temperature, environmental humidity, wind speed, wind direction, radiation amount, and other indicators. According to formula (1), the correlation analysis of the evaluation factors was carried out:(1)ζ=∑i=1Nxi−x¯yi−y¯∑i=1Nxi−x¯2∑i=1Nyi−y¯2.In Figure1, the linear features denoted by (a) and (b) are consistent, which are either a line segment or a part of an object without any difference. However, given the overall information, the information represented by (c) is completely inconsistent. Thus, the question of how to extract this nonlinear feature effectively is raised. This question is determined by the micro network structure embedded in NIN network, that is, a full connection layer consisting of two layers of convolution. In the neural network, two-layer fully connected hidden neurons are capable of approximating arbitrary curves, where ζ is the correlation coefficient, xi is the i-th value of factor x, x¯ is the mean of factor x, yi is the i-th value of factor y, and y¯ is the mean of factor y. Table 1 shows the correlation coefficient analysis of PV generation with meteorological factors and historical power generation.Figure 1
Cell structure of LSTM.Table 1
Correlation coefficient between PV generation and other factors.
FactorsETEHWSWDRQHQPGET1.00−0.420.120.020.480.550.56EH−0.421.00−0.17−0.33−0.36−0.24−0.38WS0.12−0.171.00−0.210.220.120.22WD0.02−0.33−0.211.000.060.200.07RQ0.48−0.360.220.061.000.960.92HQ0.55−0.240.120.200.961.000.86PG0.56−0.380.220.070.920.861.00ET: environment temperature; EH: environment humidity; WS: wind speed; WD: wind direction; RQ: radiation quantity; HQ: historical quantity; PG: power generation.Table1 demonstrates that electricity generation is highly correlated with solar radiation and historical electricity generation, valued at 0.92 and 0.86, respectively. Moreover, it had a moderate correlation with environmental temperature of 0.56 and had a weak correlation with wind direction and wind speed, though it was found to be negatively correlated with environmental humidity. Therefore, the prediction model adopted environmental temperature, environmental humidity, solar radiation, and historical power generation as its input components, and the correlation between various input components was observed to be strong; hence, carrying out a principal component analysis was required.


### 2.2. CCIPCA

Due to the advent of big data in PV generation, data preprocessing is particularly important. The PV generation system possesses a simple structure; however, it contains a large amount of equipment and has many failure-prone points. Additionally, the collected data has noise, which introduces obstacles in processing big data. The traditional principal component analysis (PCA) reduces dimensions by eliminating data in the dimension having small variance, which maximizes the information of the original data and removes noise to a certain extent. However, PCA must input all sample data before starting the analysis, which does not align with the objectives of big data; hence, the Candid Covariance-free Incremental Principal Component Analysis (CCIPCA) method was proposed. Unlike the batch method, which uses the covariance matrix to calculate eigenvalues and eigenvectors, CCIPCA initially eliminates the calculation of the covariance matrix using the asymptotic method to estimate the principal component values obtained by approximating the batch method. This data processing technique satisfies the requirements of photovoltaic data processing.Recently, research related to incremental principal component analysis has been ongoing. Oja and Karhunen et al. proposed the SGA algorithm [10], where, after receiving new sample data, the algorithm continuously refreshes the estimated value of feature vectors and normalizes the new estimated value with all of the previous feature vectors. Sanger put forward the GHA algorithm, which uses a single-layer linear neural network to extract principal elements [11]. Furthermore, Weng et al. described the CCIPCA algorithm [12], which is comprised of the following framework: gradually obtain data x1,x2,…,xn,… and calculate the previous k principal elements v1n,v2n,…,vkn. The calculation process of CCIPCA is given below.According to derivation of PCA by the maximum variance theory [13], the total variance A of the data set X projected along a unit vector w is obtained as follows:(2)A=1n∑i=1nxi−x¯xi−x¯T=1n∑i=1nuiuiT,where x¯ denotes the mean of data set X; that is x¯=∑i=1nxi/n, ui=xi−x¯, and A denotes the covariance matrix of data set X (the general covariance matrix is divided by n−1, where n is used).The calculation formula of thei-th eigenvalue and the i-th eigenvector is as follows:(3)λinwin=Awin,where win denotes the n-th eigenvector to be calculated at the i-th input and λin denotes the corresponding eigenvalue. In order to speed up the iteration of CCIPCA algorithm, the whole iteration is based on the product λinwin of eigenvalues and eigenvectors. When the i-th data is input, the following formula is obtained:(4)vin=λinwin=Awin.Based on formulae (2) and (4),(5)vin=1n∑i=1nuiuiTwin.The productvin of eigenvalue and eigenvector is obtained by iteration. As the eigenvector is normalized, λin and win can be separately obtained with vin and vin/vin.Formula (5) uses vi,n−1/vi,n−1 to approximate win and replace it. The basic iterative formula of CCIPCA can be obtained by transformation.(6)vin=n−1nvi,n−1+1nununTvi,n−1vi,n−1,where n−1/n denotes the weight of the previous iteration value vi,n−1 and 1/n denotes the adjustment step size of the iteration.With the adjustment of the iteration vectorvin by the new input data un, that is, un=xn−x¯, vin gradually converges to the i-th eigenvector. For different vi, formula (6) can be used for iteration with the different input vectors un.The first eigenvector has been obtained by iteration. Firstly,u1n=un is projected onto the previous eigenvector (now the first eigenvector), and the residual data is obtained as follows:(7)u2n=u1n−u1nTv1nv1nv1nv1n.u2n denotes the output of the second eigenvector. The third and fourth eigenvector can be similarly obtained. Since the residual data is orthogonal to the data recovered from the previous eigenvector, all orthogonal eigenvectors can be obtained. In addition, the mean should be updated every time when a new data is input. The mean of the n-th data input adopts the following iterative formula:(8)x¯n=n−1nx¯n−1+1nunT.The CCIPCA solution process is summarized in Algorithm1.Algorithm 1: CCIPCA solution process.
Input data:original data sequencex1,x2,…,xn,…,% the algorithm can pause the output of projection matrix at any time.dimension of low-dimensional spacek.Initialization:x¯0=0Output: projection matrixW∗=w1=v1/v1,w2=v2/v2,…,wk=vk/vkIteration steps:Forn=1,2,…, % Run the following steps to update k feature vectorsu1n=un=xn−x¯n−1;Ifn==1:x¯n=x¯n−1+unTElse:x¯n=n−1/nx¯n−1+1/nunT; % Update mean vectorFori=1,2,…,mink,n do:(a)  Ifi=n: vin=uin; % Initialize the i-th eigenvector(b)  Otherwise:vin=n−1/nvi,n−1+1/nuinuinTvi,n−1/vi,n−1ui+1,n=uin−uinTvin/vinvin/vinThe CCIPCA algorithm has been widely used in the field of big data processing as well as the decomposition of large matrices due to its good convergence, which has achieved beneficial results. Meanwhile, as a benchmark algorithm, CCIPCA has been cited in various incremental algorithms. In this paper, it was applied in big data preprocessing of the PV station with a time dimension to make up for PCA preprocessing defects.


### 2.3. LSTM

In recent years, the improvement of LSTM has been continuously carried out. Yao et al. [14] proposed an improved NLP method based on Long Short-Term Memory (LSTM) structure, whose parameters are randomly discarded when they are passed backwards in the recursive projection layer, and it is used to overcome practical problems, such as high training complexity, computational difficulties in large-scale content scenarios, high retrieval complexity, and lack of probabilistic significance. Tian et al. [15] proposed a hybrid prediction modelling strategy by combining the autocorrelation local characteristic-scale decomposition and the improved LSTM neural network. Zhang et al. [16] proposed a LSTM approach for bearing performance degradation evaluation. Numerical results show that the proposed LSTM method can effectively predict the remaining service life of the bearing. Li et al. [17] proposed a LSTM method for fault diagnosis and isolation of wind turbine, where stochastic forest algorithm is applied to make decision. Liu et al. [18] combined probabilistic decision-making methods and proposed a Bayesian LSTM algorithm for intelligent fault early-warning of nuclear power machinery. Mirza et al. [19] introduce efficient online learning algorithms based on the Long Short-Term Memory (LSTM) networks that employ the covariance information. They reduce the number of system parameters through the weight matrix factorization, where they convert the LSTM weight matrices into two smaller matrices in order to achieve high learning performance with low computational complexity.LSTM is an evolutionary version of RNN, which effectively addresses the issue of long-term dependence of effective information in time series and has been broadly applied for different fields. In comparison to other models, the LSTM method is more sensitive to the trivial features in the historical data, easier to capture the details, suitable for big data processing, and more accurate in time series prediction. LSTM replaces the hidden layer of neurons in RNN with a memory unit to record the dependency relationship between time series data, which then rids itself of problems like gradient disappearance and gradient explosion occurring in RNN. LSTM utilizes a “gate” to control information selection. Compared with a dropout operation, this process is not random, though it implements Boolean selection based on sigmoid operation results with “0” signifying the forgetting of information and “1” meaning the remembering of information. The LSTM structure includes three gate structures that adjust the information flow, namely, the forgotten gate, input gate, and output gate, as shown in Figure1.The forgotten gate determines the degree to which the unit stateKt−1 at the last time is retained to the current state Kt, which is calculated as(9)ft=SigmoidWfht−1,xt+cf,where ft is the output value and the bias of the forgotten gate.The input gate controls the extent to which network inputxt is saved to the cell state Kt at the previous time, which is calculated as(10)Kt=ftct+itK˜t,it=SigmoidWiht−1,xt+ci,K˜t=tanhWkht−1,xt+ck.The output gate controls the current output valueht of unit state Kt outputting to LSTM, which is calculated as(11)ot=SigmoidWoht−1,xt+co,ht=ottanhKt.If the output value has reached the threshold value required by the memory unit, the product of the output value with the calculated value of the current layer is taken as the output, and the calculation is carried out in the next layer. If the threshold is not reached, the memory unit will forget it.Different from the traditional RNN, LSTM can solve the issues of gradient disappearance and gradient explosion in the training process, yielding more accurate prediction of a long-term time series. LSTM is developed to address data uncertainty while considering complicated situation of the operation.


## 2.1. Analysis of Correlation Factors in Power Generation Prediction

The sample data adopted the data of PV station no. 11282, Zhangdian District, Zibo City, Shandong Province, China, which was provided by SolarGIS. Its geographical location is 118 degrees east longitude and 32 degrees north latitude. The data includes total solar radiation data such as horizontal radiation GHI and normal direct radiation DNI and meteorological parameters like temperature, humidity, and pressure, as well as environmental parameters such as elevation, surface inclination angle, and surface azimuth angle. There were a total of 37 dimensions and 30 minutes of resolution.Considering that parameters like geographical location are constant and have little influence on power generation prediction, the prediction model will not be considered. Meteorological and historical power generation data were taken as the main influencing factors of the model, including power generation every 30 minutes, power generation at the moment in history, environmental temperature, environmental humidity, wind speed, wind direction, radiation amount, and other indicators. According to formula (1), the correlation analysis of the evaluation factors was carried out:(1)ζ=∑i=1Nxi−x¯yi−y¯∑i=1Nxi−x¯2∑i=1Nyi−y¯2.In Figure1, the linear features denoted by (a) and (b) are consistent, which are either a line segment or a part of an object without any difference. However, given the overall information, the information represented by (c) is completely inconsistent. Thus, the question of how to extract this nonlinear feature effectively is raised. This question is determined by the micro network structure embedded in NIN network, that is, a full connection layer consisting of two layers of convolution. In the neural network, two-layer fully connected hidden neurons are capable of approximating arbitrary curves, where ζ is the correlation coefficient, xi is the i-th value of factor x, x¯ is the mean of factor x, yi is the i-th value of factor y, and y¯ is the mean of factor y. Table 1 shows the correlation coefficient analysis of PV generation with meteorological factors and historical power generation.Figure 1
Cell structure of LSTM.Table 1
Correlation coefficient between PV generation and other factors.
FactorsETEHWSWDRQHQPGET1.00−0.420.120.020.480.550.56EH−0.421.00−0.17−0.33−0.36−0.24−0.38WS0.12−0.171.00−0.210.220.120.22WD0.02−0.33−0.211.000.060.200.07RQ0.48−0.360.220.061.000.960.92HQ0.55−0.240.120.200.961.000.86PG0.56−0.380.220.070.920.861.00ET: environment temperature; EH: environment humidity; WS: wind speed; WD: wind direction; RQ: radiation quantity; HQ: historical quantity; PG: power generation.Table1 demonstrates that electricity generation is highly correlated with solar radiation and historical electricity generation, valued at 0.92 and 0.86, respectively. Moreover, it had a moderate correlation with environmental temperature of 0.56 and had a weak correlation with wind direction and wind speed, though it was found to be negatively correlated with environmental humidity. Therefore, the prediction model adopted environmental temperature, environmental humidity, solar radiation, and historical power generation as its input components, and the correlation between various input components was observed to be strong; hence, carrying out a principal component analysis was required.


## 2.2. CCIPCA

Due to the advent of big data in PV generation, data preprocessing is particularly important. The PV generation system possesses a simple structure; however, it contains a large amount of equipment and has many failure-prone points. Additionally, the collected data has noise, which introduces obstacles in processing big data. The traditional principal component analysis (PCA) reduces dimensions by eliminating data in the dimension having small variance, which maximizes the information of the original data and removes noise to a certain extent. However, PCA must input all sample data before starting the analysis, which does not align with the objectives of big data; hence, the Candid Covariance-free Incremental Principal Component Analysis (CCIPCA) method was proposed. Unlike the batch method, which uses the covariance matrix to calculate eigenvalues and eigenvectors, CCIPCA initially eliminates the calculation of the covariance matrix using the asymptotic method to estimate the principal component values obtained by approximating the batch method. This data processing technique satisfies the requirements of photovoltaic data processing.Recently, research related to incremental principal component analysis has been ongoing. Oja and Karhunen et al. proposed the SGA algorithm [10], where, after receiving new sample data, the algorithm continuously refreshes the estimated value of feature vectors and normalizes the new estimated value with all of the previous feature vectors. Sanger put forward the GHA algorithm, which uses a single-layer linear neural network to extract principal elements [11]. Furthermore, Weng et al. described the CCIPCA algorithm [12], which is comprised of the following framework: gradually obtain data x1,x2,…,xn,… and calculate the previous k principal elements v1n,v2n,…,vkn. The calculation process of CCIPCA is given below.According to derivation of PCA by the maximum variance theory [13], the total variance A of the data set X projected along a unit vector w is obtained as follows:(2)A=1n∑i=1nxi−x¯xi−x¯T=1n∑i=1nuiuiT,where x¯ denotes the mean of data set X; that is x¯=∑i=1nxi/n, ui=xi−x¯, and A denotes the covariance matrix of data set X (the general covariance matrix is divided by n−1, where n is used).The calculation formula of thei-th eigenvalue and the i-th eigenvector is as follows:(3)λinwin=Awin,where win denotes the n-th eigenvector to be calculated at the i-th input and λin denotes the corresponding eigenvalue. In order to speed up the iteration of CCIPCA algorithm, the whole iteration is based on the product λinwin of eigenvalues and eigenvectors. When the i-th data is input, the following formula is obtained:(4)vin=λinwin=Awin.Based on formulae (2) and (4),(5)vin=1n∑i=1nuiuiTwin.The productvin of eigenvalue and eigenvector is obtained by iteration. As the eigenvector is normalized, λin and win can be separately obtained with vin and vin/vin.Formula (5) uses vi,n−1/vi,n−1 to approximate win and replace it. The basic iterative formula of CCIPCA can be obtained by transformation.(6)vin=n−1nvi,n−1+1nununTvi,n−1vi,n−1,where n−1/n denotes the weight of the previous iteration value vi,n−1 and 1/n denotes the adjustment step size of the iteration.With the adjustment of the iteration vectorvin by the new input data un, that is, un=xn−x¯, vin gradually converges to the i-th eigenvector. For different vi, formula (6) can be used for iteration with the different input vectors un.The first eigenvector has been obtained by iteration. Firstly,u1n=un is projected onto the previous eigenvector (now the first eigenvector), and the residual data is obtained as follows:(7)u2n=u1n−u1nTv1nv1nv1nv1n.u2n denotes the output of the second eigenvector. The third and fourth eigenvector can be similarly obtained. Since the residual data is orthogonal to the data recovered from the previous eigenvector, all orthogonal eigenvectors can be obtained. In addition, the mean should be updated every time when a new data is input. The mean of the n-th data input adopts the following iterative formula:(8)x¯n=n−1nx¯n−1+1nunT.The CCIPCA solution process is summarized in Algorithm1.Algorithm 1: CCIPCA solution process.
Input data:original data sequencex1,x2,…,xn,…,% the algorithm can pause the output of projection matrix at any time.dimension of low-dimensional spacek.Initialization:x¯0=0Output: projection matrixW∗=w1=v1/v1,w2=v2/v2,…,wk=vk/vkIteration steps:Forn=1,2,…, % Run the following steps to update k feature vectorsu1n=un=xn−x¯n−1;Ifn==1:x¯n=x¯n−1+unTElse:x¯n=n−1/nx¯n−1+1/nunT; % Update mean vectorFori=1,2,…,mink,n do:(a)  Ifi=n: vin=uin; % Initialize the i-th eigenvector(b)  Otherwise:vin=n−1/nvi,n−1+1/nuinuinTvi,n−1/vi,n−1ui+1,n=uin−uinTvin/vinvin/vinThe CCIPCA algorithm has been widely used in the field of big data processing as well as the decomposition of large matrices due to its good convergence, which has achieved beneficial results. Meanwhile, as a benchmark algorithm, CCIPCA has been cited in various incremental algorithms. In this paper, it was applied in big data preprocessing of the PV station with a time dimension to make up for PCA preprocessing defects.


## 2.3. LSTM

In recent years, the improvement of LSTM has been continuously carried out. Yao et al. [14] proposed an improved NLP method based on Long Short-Term Memory (LSTM) structure, whose parameters are randomly discarded when they are passed backwards in the recursive projection layer, and it is used to overcome practical problems, such as high training complexity, computational difficulties in large-scale content scenarios, high retrieval complexity, and lack of probabilistic significance. Tian et al. [15] proposed a hybrid prediction modelling strategy by combining the autocorrelation local characteristic-scale decomposition and the improved LSTM neural network. Zhang et al. [16] proposed a LSTM approach for bearing performance degradation evaluation. Numerical results show that the proposed LSTM method can effectively predict the remaining service life of the bearing. Li et al. [17] proposed a LSTM method for fault diagnosis and isolation of wind turbine, where stochastic forest algorithm is applied to make decision. Liu et al. [18] combined probabilistic decision-making methods and proposed a Bayesian LSTM algorithm for intelligent fault early-warning of nuclear power machinery. Mirza et al. [19] introduce efficient online learning algorithms based on the Long Short-Term Memory (LSTM) networks that employ the covariance information. They reduce the number of system parameters through the weight matrix factorization, where they convert the LSTM weight matrices into two smaller matrices in order to achieve high learning performance with low computational complexity.LSTM is an evolutionary version of RNN, which effectively addresses the issue of long-term dependence of effective information in time series and has been broadly applied for different fields. In comparison to other models, the LSTM method is more sensitive to the trivial features in the historical data, easier to capture the details, suitable for big data processing, and more accurate in time series prediction. LSTM replaces the hidden layer of neurons in RNN with a memory unit to record the dependency relationship between time series data, which then rids itself of problems like gradient disappearance and gradient explosion occurring in RNN. LSTM utilizes a “gate” to control information selection. Compared with a dropout operation, this process is not random, though it implements Boolean selection based on sigmoid operation results with “0” signifying the forgetting of information and “1” meaning the remembering of information. The LSTM structure includes three gate structures that adjust the information flow, namely, the forgotten gate, input gate, and output gate, as shown in Figure1.The forgotten gate determines the degree to which the unit stateKt−1 at the last time is retained to the current state Kt, which is calculated as(9)ft=SigmoidWfht−1,xt+cf,where ft is the output value and the bias of the forgotten gate.The input gate controls the extent to which network inputxt is saved to the cell state Kt at the previous time, which is calculated as(10)Kt=ftct+itK˜t,it=SigmoidWiht−1,xt+ci,K˜t=tanhWkht−1,xt+ck.The output gate controls the current output valueht of unit state Kt outputting to LSTM, which is calculated as(11)ot=SigmoidWoht−1,xt+co,ht=ottanhKt.If the output value has reached the threshold value required by the memory unit, the product of the output value with the calculated value of the current layer is taken as the output, and the calculation is carried out in the next layer. If the threshold is not reached, the memory unit will forget it.Different from the traditional RNN, LSTM can solve the issues of gradient disappearance and gradient explosion in the training process, yielding more accurate prediction of a long-term time series. LSTM is developed to address data uncertainty while considering complicated situation of the operation.


## 3. PV Generation Prediction

### 3.1. Process of PV Generation Prediction

Power generation prediction conducted by CCIPCA combined with LSTM conforms to current trends in photovoltaic big data. The prediction process initially processes the CCIPCA algorithm for the collected big data samples, which then establishes the LSTM networks and implements the training of the sample data on the LSTM network. After completion, the sample data is input in order to acquire the prediction results output, as shown in Figure2. When training big data samples, it is necessary to continuously tune the discarded neuron probability, attenuation rate, and learning rate.Figure 2
Flow chart of power generation prediction by IPCA combined with LSTM.


### 3.2. Data Source and Preprocessing

SolarGIS is a solar resource assessment tool developed by SolarGIS S.R.O. in Europe, which uses satellite remote sensing data, GIS technology, and advanced scientific algorithms to obtain a high-resolution database of solar resources and climatic factors. In this paper, data from January 1, 2014, to December 31, 2019, were collected from the SolarGIS database as sample data, of which its volume reached 39.4 PB. Using formula (1), the data within a certain period were used for factor correlation evaluation, and factors with an absolute value coefficient above 0.2 were selected. In addition to selecting highly correlated factors, this paper also required two historical PV power generation horizontal and vertical mean data as the model’s input sequences to control the disturbance brought about by extreme weather, as extreme weather is a gradual process that takes place in a short amount of time. The formulae are as follows:(12)Q¯k=Qk−1+⋯+Qk−mm,Q¯k′=Qk−1′+⋯+Qk−n′n,where Qk−i,i=1,2,3,…m, represents the generating capacity of the previous continuous time units and Q¯k represents the average of horizontal generating capacity. Q¯k′ is the average vertical generating capacity of the same time unit before the previous day and Qk−i′,i=1,2,3,…,n, is the electrical generation of the previous n days.Actual power generation always fluctuates around the mean curve of the horizontal and vertical power generation, which can be used as a stable factor in the prediction model to eliminate the interference of extreme weather in power generation prediction. Although weather conditions are very sporadic, the seasonal law always changes with Earth’s revolution and rotation.Here, the horizontal mean of the first 10 time units and the vertical mean of the same time unit of the first 5 days were selected as the input. This was done because if the number choices were more, the average value would change significantly, which was not conducive to the stability of the prediction model. If there were fewer number choices, the average value would not change significantly, which was not conducive to measuring the impact of extreme weather changes on the prediction model, resulting in inaccuracies of prediction.After correlation coefficient analysis, the dimension of sample data was reduced to 18. Some sample data are listed in Table2. After the sample data were sorted, the data was preprocessed with Z-Score standardization to eliminate influences from different feature dimensions and improve the convergence speed of the model. Following completion of the prediction, a reverse operation would be carried out to achieve the real predicted value recovery. Subsequently, CCIPCA was preprocessed to map the sample data to dimensions set by the investigators, such as solar radiation amount and historical power generation. Finally, orthogonalization removed influences in the relationship between noise and dimensions.Table 2
Part of sample data after sorting.
DateDNI (W. H/m2)GHI (W. H/m2)TEMP (°C)RH (%)WS (m/s)WD (°)AP (Pa)Q¯10 (MWp)Q¯5′ (MWp)2020-06-06 05: 30: 00111121.473.20.32941000.200.13722020-06-06 06: 30: 00788023.9610.73491000.20.00330.85622020-06-06 07: 30: 0019720226.153.60.72661000.50.05382.13222020-06-06 08: 30: 0032232528.447.51.72321000.90.19943.27942020-06-06 09: 30: 0048448129.740.22.52911000.80.44214.16342020-06-06 10: 30: 0061560531.134.83.13061000.40.80435.092GHI: global horizontal irradiation; DNI: direct normal irradiance; RH: relative humidity; AP: atmospheric pressure; WS: wind speed; WD: wind direction;Q¯10: the mean of 10 consecutive time units; Q¯5′: the mean of 5 consecutive days at the same time; PVOUT: photovoltaic output per unit time.Solar radiation adopts two aspects: global horizontal radiation (GHI) and direct normal radiation (DNI). Meteorological parameters are air temperature (TEMP) at 2 m, RH, average WS and WD at 10 m, precipitation RH, and atmospheric pressure.CCIPCA preprocessing was implemented. 48 pieces of data on June 6, 2019, were used as data series input one by one. The low-dimensional spatial dimension was set to 18. The eigenvector and eigenvalue were calculated, and principal component analysis was conducted to remove the influence of noise and the relationship between dimensions. The results of principal component analysis are shown in Table3.Table 3
Eigenvalue and variance contribution of the input variables.
NumberEigenvalueVariance contribution rate (%)Cumulative variance contribution rate (%)16.4023.1623.1625.0220.3243.4834.2617.5561.0343.2410.1271.1552.607.6178.7661.074.2382.99…………1800100It can be determined from Table3 that the cumulative variance contribution rate of the first six eigenvalues is more than 80%. Therefore, six principal components were selected, and the corresponding eigenvectors of the six principal components were selected to construct the transformation matrix. The original data and the transformation matrix are calculated, and the input variables obtained were input into LSTM for prediction.


### 3.3. Evaluation Indexes

After the completion of the model training, the generation capacity of the PV station in 1 day of continuous time was selected for prediction to judge the accuracy and efficacy of the entire model. Here, the mean square error was used as a loss function to test and measure the model’s efficacy. The mean square error was calculated as(13)MSE=1m∑i=1myi−y^ii2,where MSE is the mean square error, yi is the actual power generation at time I, y^i is the prediction value of the model at time I, and m is the amount of sample data. Accordingly, the smaller the mean square error, the higher the model precision.In addition, the maximum error was used to measure the prediction error range of the model. The larger the value ofME, the worse the accuracy of the model, which was computed as(14)ME=maxyi−y^iyi,i=1,2,3,…,m.


### 3.4. Model Building and Experimental Results Analysis

The experimental environment is Intel i9 processor, Linux + anaconda3 + tensorflow2.0 platform, Spyder software, and Python 3.7 programming language.The LSTM model structure determines the optimization and prediction accuracy of the training process. In this paper, the LSTM network structure having 4 hidden layers of LSTM and 1 ordinary layer was adopted. The number of neurons in each layer was 512, 256, 128, and 64, respectively. Specifically, 64 neurons were used as the ordinary layer, and dropout operations were used between layers. The overall structure of LSTM is shown in Figure3.Figure 3
LSTM prediction model of the PV station’s generation.Relevant literature discusses the setting of training parameters of LSTM. When the learning rate and attenuation rate are different, the network performance is not the same, and the prediction effect is also different. If LSTM has dropout layers, the probability of dropping neurons is also the key to parameter optimization. According to the comprehensive literature [9, 11], the learning rate is generally small, or the learning rate is degraded dynamically; that is, when the accuracy rate in the network training process is no longer improved, the learning rate will be reduced to one-tenth of the original or lower. The probability of discarded neurons is 0.2 and its vicinity, and the decay rate is 0.9 and its vicinity.The data taken between 2014 and 2018 were used as the training set, while the data taken from 2019 acted as the test set. After the sample data were standardized, PCA and CCIPCA pretreatment were performed, respectively, and training and testing were conducted on the LSTM. The probability of dropping neurons in the dropout layer was {0.1, 0.2, 0.3}; the attenuation rate was {0.8, 0.9} and the learning rate was 0.001. Moreover, the number of training iterations was 100. The experimental results are shown in Table4.Table 4
Experimental results of the LSTM model under different parameters of optimization.
ModelP = 0.8P = 0.9N = 0.1N = 0.2N = 0.3N = 0.1N = 0.2N = 0.3LSTM [20]0.0810.0720.0640.0790.0780.074PCA + LSTM0.0790.0700.0580.0730.0620.061CCIPCA + LSTM0.0620.0590.0460.0480.0440.041Table4 demonstrates that the prediction accuracy of power generation obtained after CCIPCA processing of the sample data was better than that of PCA + LSTM and LSTM. The LSTM model of N = 0.3 and P = 0.9 was selected to draw the loss function value curve of the training set after 100 iterations. As shown in Figure 4, CCIPCA + LSTM exhibited better convergence as well as a better convergence rate than that of LSTM and PCA + LSTM.Figure 4
Loss function curve of training set and test set.From the period of 2019, multidays data were selected as test sets in different seasons, and the prediction accuracy of the model was compared with the real power generation.The data from January 3, 2019, was selected as the test set for comparison with the actual power generation, as shown in Figure5(a). According to the record, it was light snow, but it was heavy snow three days ago and it turned to clear up after 14: 00. On that day, the temperature range was −2–4°C, with no wind, the wind speed range was 0–0.4 m/s, and the absolute humidity was 1.02–1.70 g/m3. Then, the data from January 4, 2019, was selected to verify the model, as shown in Figure 5(b). It was sunny, accompanied by weak solar radiation and breeze, temperature range was −5–1°C, wind speed range was 0.6–1 m/s, and the humidity was the same as the previous day.Figure 5
Power generation forecast of two days in winter. (a) Comparison between predicted curve and real value of power generation on January 3. (b) Comparison between predicted curve and real value of power generation on January 4. Note:w represents the time zone of daily effective generation and d represents the peak value of daily generation.
(a)(b)The meteorological conditions on January 3 and January 4 were similar, and the difference between two days was solar radiation, and solar radiation on January 4 was stronger than that on January 3. Compared with Figures5(a) and 5(b), the peak of power generation on January 4 was much higher than that on January 3, which indicates that solar radiation is an important factor in power generation prediction. It can also be found from the power generation prediction curve that the photovoltaic power generation efficiency was reduced accompanied by the solar radiation gradually weakening, since the sunlight irradiated the snow surface and reflected, and the ambient temperature sharply dropped in relative to normal times after 14: 00 o’clock. When the night came, there was no sunlight and the ambient temperature dropped below zero, and the photovoltaic power generation was zero.The data on April 3, 2019, were selected as the test set and compared with the real power generation, as shown in Figure6. According to the data, April 3 was sunny, the temperature range was 9–14°C, the wind direction was strong, the wind speed ranged from 17.2 to 21 m/s, and the absolute humidity was 2.7–3.2 g/m3.Figure 6
Forecast of one-day power generation in spring.It can be found from Figure6 that the predicted curve of the whole-day power generation was basically consistent with the real power generation curve, and the two curves were relatively smooth, which indicates that the power generation efficiency of photovoltaic equipment was not affected by wind direction and wind speed.The data from July 7, 2019, were selected as the test set for comparison with the actual power generation. Figure7 illustrates that the data recorded exhibited three thundershowers and severe convection weather on July 7, with periods of 3: 00–4: 00, 7: 00–7: 30, and 14: 00–14: 30, respectively. The meteorological conditions were temperature range of 20–32°C, gust, wind speed of 10.8–13.8 m/s, and absolute humidity of 22.22–25.76 g/m3.Figure 7
Forecast of one-day power generation in autumn.Figure8 illustrates that the photovoltaic power generation efficiency is sensitive to the influence of solar radiation and ambient temperature. In the three periods of July 7, the solar radiation and environmental temperature changed rapidly, and the photovoltaic power generation also changed rapidly. The prediction results of the model are basically consistent with the real power generation under the condition of rapid changes of photovoltaic power generation factors.Figure 8
One-day power generation forecast in summer.The data on November 11, 2019, were selected as the test set and compared with the real power generation, as shown in Figure9. According to the record, it was sunny, the temperature range was 9–15°C, the breeze level was 2-3, the wind speed reached 3.1–4.0 m/s, and the absolute humidity was 1.08–2.12 g/m3.Figure 9
Comparison of photovoltaic power generation forecast from July 1 to August 31.From Figures6 and 7, it can be found that photovoltaic power generation has some relationship with environmental humidity. The meteorological conditions on November 11 and April 3 were basically the same; only the environmental humidity was different, but the peaks of the two pictures were inconsistent, which indicates that the environmental humidity has a negative effect on photovoltaic power generation. On November 11, the environmental humidity was lower, but the power generation effect was better. On April 3, the humidity was higher, and the power generation effect was poor.It can also be found from Figures5–7 that the efficiency of photovoltaic power generation is higher in summer, d in Figure 5 was much higher than that in other graphs, and the photovoltaic power generation efficiency in winter is the worst. Furthermore, w in Figure 5 was much longer than that in other graphs, which indicates that the photovoltaic equipment uses more time to generate electricity in summer.The 62-day power generation data from July 1, 2019, to August 31, 2019, were selected as the test set and compared with the real power generation; the prediction accuracy of the model is investigated. As shown in Figure9, the curve between the actual power generation and the predicted power generation in 62 days was shown.Figure9 showed that the two curves were relatively similar, indicating that the prediction accuracy of CCIPCA combined with LSTM was relatively high, and its prediction effect was satisfactory.In view of the practicability of the prediction model, horizontal experiments were conducted to compare the prediction model with the GA-BP neural network [21] and Markov chain model (MC) [22], as shown in Table 5.Table 5
ME comparison between models.
ModelMEModelMEModelMEMC0.074PCA + MC0.052CCIPCA + MC0.048GA-BP0.068PCA + GA-BP0.044CCIPCA + GA-BP0.032LSTM0.064PCA + LSTM0.040CCIPCA + LSTM0.023By comparison, prediction effect of MC is not as good as neural network, while prediction effect of LSTM is higher than GA-BP network due to the advantage of network layer number, and the maximum error is 6.4%; under the dimension reduction operation of PCA for photovoltaic data, the three prediction models are significantly improved, but, due to the limitations of PCA algorithm, the function mapping from high-dimensional space to low-dimensional space is linear. However, in many practical tasks, it may need nonlinear mapping to find the proper low-dimensional embedding, which leads to the poor dimensionality reduction effect of photovoltaic data. The prediction error of PCA combined with LSTM is 4%, which is higher than that of PCA combined with MC and GA-BP. However, the dimensionality reduction of PV data using IPCA avoids the complex covariance matrix calculation of PCA, and the regularization effect of IPCA is better than that of PCA, which is suitable for LSTM. The prediction error of IPCA combined with LSTM is 2.3%. In a word, the prediction model combining CCIPCA with LSTM displayed better prediction than other models, with an error range of prediction results within 3%.


## 3.1. Process of PV Generation Prediction

Power generation prediction conducted by CCIPCA combined with LSTM conforms to current trends in photovoltaic big data. The prediction process initially processes the CCIPCA algorithm for the collected big data samples, which then establishes the LSTM networks and implements the training of the sample data on the LSTM network. After completion, the sample data is input in order to acquire the prediction results output, as shown in Figure2. When training big data samples, it is necessary to continuously tune the discarded neuron probability, attenuation rate, and learning rate.Figure 2
Flow chart of power generation prediction by IPCA combined with LSTM.


## 3.2. Data Source and Preprocessing

SolarGIS is a solar resource assessment tool developed by SolarGIS S.R.O. in Europe, which uses satellite remote sensing data, GIS technology, and advanced scientific algorithms to obtain a high-resolution database of solar resources and climatic factors. In this paper, data from January 1, 2014, to December 31, 2019, were collected from the SolarGIS database as sample data, of which its volume reached 39.4 PB. Using formula (1), the data within a certain period were used for factor correlation evaluation, and factors with an absolute value coefficient above 0.2 were selected. In addition to selecting highly correlated factors, this paper also required two historical PV power generation horizontal and vertical mean data as the model’s input sequences to control the disturbance brought about by extreme weather, as extreme weather is a gradual process that takes place in a short amount of time. The formulae are as follows:(12)Q¯k=Qk−1+⋯+Qk−mm,Q¯k′=Qk−1′+⋯+Qk−n′n,where Qk−i,i=1,2,3,…m, represents the generating capacity of the previous continuous time units and Q¯k represents the average of horizontal generating capacity. Q¯k′ is the average vertical generating capacity of the same time unit before the previous day and Qk−i′,i=1,2,3,…,n, is the electrical generation of the previous n days.Actual power generation always fluctuates around the mean curve of the horizontal and vertical power generation, which can be used as a stable factor in the prediction model to eliminate the interference of extreme weather in power generation prediction. Although weather conditions are very sporadic, the seasonal law always changes with Earth’s revolution and rotation.Here, the horizontal mean of the first 10 time units and the vertical mean of the same time unit of the first 5 days were selected as the input. This was done because if the number choices were more, the average value would change significantly, which was not conducive to the stability of the prediction model. If there were fewer number choices, the average value would not change significantly, which was not conducive to measuring the impact of extreme weather changes on the prediction model, resulting in inaccuracies of prediction.After correlation coefficient analysis, the dimension of sample data was reduced to 18. Some sample data are listed in Table2. After the sample data were sorted, the data was preprocessed with Z-Score standardization to eliminate influences from different feature dimensions and improve the convergence speed of the model. Following completion of the prediction, a reverse operation would be carried out to achieve the real predicted value recovery. Subsequently, CCIPCA was preprocessed to map the sample data to dimensions set by the investigators, such as solar radiation amount and historical power generation. Finally, orthogonalization removed influences in the relationship between noise and dimensions.Table 2
Part of sample data after sorting.
DateDNI (W. H/m2)GHI (W. H/m2)TEMP (°C)RH (%)WS (m/s)WD (°)AP (Pa)Q¯10 (MWp)Q¯5′ (MWp)2020-06-06 05: 30: 00111121.473.20.32941000.200.13722020-06-06 06: 30: 00788023.9610.73491000.20.00330.85622020-06-06 07: 30: 0019720226.153.60.72661000.50.05382.13222020-06-06 08: 30: 0032232528.447.51.72321000.90.19943.27942020-06-06 09: 30: 0048448129.740.22.52911000.80.44214.16342020-06-06 10: 30: 0061560531.134.83.13061000.40.80435.092GHI: global horizontal irradiation; DNI: direct normal irradiance; RH: relative humidity; AP: atmospheric pressure; WS: wind speed; WD: wind direction;Q¯10: the mean of 10 consecutive time units; Q¯5′: the mean of 5 consecutive days at the same time; PVOUT: photovoltaic output per unit time.Solar radiation adopts two aspects: global horizontal radiation (GHI) and direct normal radiation (DNI). Meteorological parameters are air temperature (TEMP) at 2 m, RH, average WS and WD at 10 m, precipitation RH, and atmospheric pressure.CCIPCA preprocessing was implemented. 48 pieces of data on June 6, 2019, were used as data series input one by one. The low-dimensional spatial dimension was set to 18. The eigenvector and eigenvalue were calculated, and principal component analysis was conducted to remove the influence of noise and the relationship between dimensions. The results of principal component analysis are shown in Table3.Table 3
Eigenvalue and variance contribution of the input variables.
NumberEigenvalueVariance contribution rate (%)Cumulative variance contribution rate (%)16.4023.1623.1625.0220.3243.4834.2617.5561.0343.2410.1271.1552.607.6178.7661.074.2382.99…………1800100It can be determined from Table3 that the cumulative variance contribution rate of the first six eigenvalues is more than 80%. Therefore, six principal components were selected, and the corresponding eigenvectors of the six principal components were selected to construct the transformation matrix. The original data and the transformation matrix are calculated, and the input variables obtained were input into LSTM for prediction.


## 3.3. Evaluation Indexes

After the completion of the model training, the generation capacity of the PV station in 1 day of continuous time was selected for prediction to judge the accuracy and efficacy of the entire model. Here, the mean square error was used as a loss function to test and measure the model’s efficacy. The mean square error was calculated as(13)MSE=1m∑i=1myi−y^ii2,where MSE is the mean square error, yi is the actual power generation at time I, y^i is the prediction value of the model at time I, and m is the amount of sample data. Accordingly, the smaller the mean square error, the higher the model precision.In addition, the maximum error was used to measure the prediction error range of the model. The larger the value ofME, the worse the accuracy of the model, which was computed as(14)ME=maxyi−y^iyi,i=1,2,3,…,m.


## 3.4. Model Building and Experimental Results Analysis

The experimental environment is Intel i9 processor, Linux + anaconda3 + tensorflow2.0 platform, Spyder software, and Python 3.7 programming language.The LSTM model structure determines the optimization and prediction accuracy of the training process. In this paper, the LSTM network structure having 4 hidden layers of LSTM and 1 ordinary layer was adopted. The number of neurons in each layer was 512, 256, 128, and 64, respectively. Specifically, 64 neurons were used as the ordinary layer, and dropout operations were used between layers. The overall structure of LSTM is shown in Figure3.Figure 3
LSTM prediction model of the PV station’s generation.Relevant literature discusses the setting of training parameters of LSTM. When the learning rate and attenuation rate are different, the network performance is not the same, and the prediction effect is also different. If LSTM has dropout layers, the probability of dropping neurons is also the key to parameter optimization. According to the comprehensive literature [9, 11], the learning rate is generally small, or the learning rate is degraded dynamically; that is, when the accuracy rate in the network training process is no longer improved, the learning rate will be reduced to one-tenth of the original or lower. The probability of discarded neurons is 0.2 and its vicinity, and the decay rate is 0.9 and its vicinity.The data taken between 2014 and 2018 were used as the training set, while the data taken from 2019 acted as the test set. After the sample data were standardized, PCA and CCIPCA pretreatment were performed, respectively, and training and testing were conducted on the LSTM. The probability of dropping neurons in the dropout layer was {0.1, 0.2, 0.3}; the attenuation rate was {0.8, 0.9} and the learning rate was 0.001. Moreover, the number of training iterations was 100. The experimental results are shown in Table4.Table 4
Experimental results of the LSTM model under different parameters of optimization.
ModelP = 0.8P = 0.9N = 0.1N = 0.2N = 0.3N = 0.1N = 0.2N = 0.3LSTM [20]0.0810.0720.0640.0790.0780.074PCA + LSTM0.0790.0700.0580.0730.0620.061CCIPCA + LSTM0.0620.0590.0460.0480.0440.041Table4 demonstrates that the prediction accuracy of power generation obtained after CCIPCA processing of the sample data was better than that of PCA + LSTM and LSTM. The LSTM model of N = 0.3 and P = 0.9 was selected to draw the loss function value curve of the training set after 100 iterations. As shown in Figure 4, CCIPCA + LSTM exhibited better convergence as well as a better convergence rate than that of LSTM and PCA + LSTM.Figure 4
Loss function curve of training set and test set.From the period of 2019, multidays data were selected as test sets in different seasons, and the prediction accuracy of the model was compared with the real power generation.The data from January 3, 2019, was selected as the test set for comparison with the actual power generation, as shown in Figure5(a). According to the record, it was light snow, but it was heavy snow three days ago and it turned to clear up after 14: 00. On that day, the temperature range was −2–4°C, with no wind, the wind speed range was 0–0.4 m/s, and the absolute humidity was 1.02–1.70 g/m3. Then, the data from January 4, 2019, was selected to verify the model, as shown in Figure 5(b). It was sunny, accompanied by weak solar radiation and breeze, temperature range was −5–1°C, wind speed range was 0.6–1 m/s, and the humidity was the same as the previous day.Figure 5
Power generation forecast of two days in winter. (a) Comparison between predicted curve and real value of power generation on January 3. (b) Comparison between predicted curve and real value of power generation on January 4. Note:w represents the time zone of daily effective generation and d represents the peak value of daily generation.
(a)(b)The meteorological conditions on January 3 and January 4 were similar, and the difference between two days was solar radiation, and solar radiation on January 4 was stronger than that on January 3. Compared with Figures5(a) and 5(b), the peak of power generation on January 4 was much higher than that on January 3, which indicates that solar radiation is an important factor in power generation prediction. It can also be found from the power generation prediction curve that the photovoltaic power generation efficiency was reduced accompanied by the solar radiation gradually weakening, since the sunlight irradiated the snow surface and reflected, and the ambient temperature sharply dropped in relative to normal times after 14: 00 o’clock. When the night came, there was no sunlight and the ambient temperature dropped below zero, and the photovoltaic power generation was zero.The data on April 3, 2019, were selected as the test set and compared with the real power generation, as shown in Figure6. According to the data, April 3 was sunny, the temperature range was 9–14°C, the wind direction was strong, the wind speed ranged from 17.2 to 21 m/s, and the absolute humidity was 2.7–3.2 g/m3.Figure 6
Forecast of one-day power generation in spring.It can be found from Figure6 that the predicted curve of the whole-day power generation was basically consistent with the real power generation curve, and the two curves were relatively smooth, which indicates that the power generation efficiency of photovoltaic equipment was not affected by wind direction and wind speed.The data from July 7, 2019, were selected as the test set for comparison with the actual power generation. Figure7 illustrates that the data recorded exhibited three thundershowers and severe convection weather on July 7, with periods of 3: 00–4: 00, 7: 00–7: 30, and 14: 00–14: 30, respectively. The meteorological conditions were temperature range of 20–32°C, gust, wind speed of 10.8–13.8 m/s, and absolute humidity of 22.22–25.76 g/m3.Figure 7
Forecast of one-day power generation in autumn.Figure8 illustrates that the photovoltaic power generation efficiency is sensitive to the influence of solar radiation and ambient temperature. In the three periods of July 7, the solar radiation and environmental temperature changed rapidly, and the photovoltaic power generation also changed rapidly. The prediction results of the model are basically consistent with the real power generation under the condition of rapid changes of photovoltaic power generation factors.Figure 8
One-day power generation forecast in summer.The data on November 11, 2019, were selected as the test set and compared with the real power generation, as shown in Figure9. According to the record, it was sunny, the temperature range was 9–15°C, the breeze level was 2-3, the wind speed reached 3.1–4.0 m/s, and the absolute humidity was 1.08–2.12 g/m3.Figure 9
Comparison of photovoltaic power generation forecast from July 1 to August 31.From Figures6 and 7, it can be found that photovoltaic power generation has some relationship with environmental humidity. The meteorological conditions on November 11 and April 3 were basically the same; only the environmental humidity was different, but the peaks of the two pictures were inconsistent, which indicates that the environmental humidity has a negative effect on photovoltaic power generation. On November 11, the environmental humidity was lower, but the power generation effect was better. On April 3, the humidity was higher, and the power generation effect was poor.It can also be found from Figures5–7 that the efficiency of photovoltaic power generation is higher in summer, d in Figure 5 was much higher than that in other graphs, and the photovoltaic power generation efficiency in winter is the worst. Furthermore, w in Figure 5 was much longer than that in other graphs, which indicates that the photovoltaic equipment uses more time to generate electricity in summer.The 62-day power generation data from July 1, 2019, to August 31, 2019, were selected as the test set and compared with the real power generation; the prediction accuracy of the model is investigated. As shown in Figure9, the curve between the actual power generation and the predicted power generation in 62 days was shown.Figure9 showed that the two curves were relatively similar, indicating that the prediction accuracy of CCIPCA combined with LSTM was relatively high, and its prediction effect was satisfactory.In view of the practicability of the prediction model, horizontal experiments were conducted to compare the prediction model with the GA-BP neural network [21] and Markov chain model (MC) [22], as shown in Table 5.Table 5
ME comparison between models.
ModelMEModelMEModelMEMC0.074PCA + MC0.052CCIPCA + MC0.048GA-BP0.068PCA + GA-BP0.044CCIPCA + GA-BP0.032LSTM0.064PCA + LSTM0.040CCIPCA + LSTM0.023By comparison, prediction effect of MC is not as good as neural network, while prediction effect of LSTM is higher than GA-BP network due to the advantage of network layer number, and the maximum error is 6.4%; under the dimension reduction operation of PCA for photovoltaic data, the three prediction models are significantly improved, but, due to the limitations of PCA algorithm, the function mapping from high-dimensional space to low-dimensional space is linear. However, in many practical tasks, it may need nonlinear mapping to find the proper low-dimensional embedding, which leads to the poor dimensionality reduction effect of photovoltaic data. The prediction error of PCA combined with LSTM is 4%, which is higher than that of PCA combined with MC and GA-BP. However, the dimensionality reduction of PV data using IPCA avoids the complex covariance matrix calculation of PCA, and the regularization effect of IPCA is better than that of PCA, which is suitable for LSTM. The prediction error of IPCA combined with LSTM is 2.3%. In a word, the prediction model combining CCIPCA with LSTM displayed better prediction than other models, with an error range of prediction results within 3%.


## 4. Conclusions

In view of issues such as data being collected by PV stations in a matter of minutes, daily data volume reaching the GB or PB level, data scale being large, multiple instances of data dimensions [23], and existence of noise [24], this paper proposed a prediction model for PV generation by combining CCIPCA with LSTM. According to the simulation of the proposed prediction model, the following conclusions were drawn:(1)
CCIPCA has handled the super-large-scale data of PV station, realized the dimensionality reduction of data, made use of orthogonalization following dimensionality reduction of data, eliminated the influence of noise, and improved the convergence speed and training speed of the model.(2)
During model training, the historical horizontal and vertical mean values of PV generation were added to eliminate the disturbance of extreme weather conditions on the model, and 48 sets of data from a certain day were selected for testing. The obtained results aligned with the real values of power generation, demonstrating the model’s stable performance.(3)
The model was compared to the other two PV generation prediction models horizontally, and the power generation prediction error was determined to be less than 3%, illustrating its practicality.



---

*Source: 1929372-2020-09-15.xml*