# Chaotic Time Series for Copper's Price Forecast

Raúl Carrasco, Manuel Vargas, Ismael Soto, Diego Fuentealba, Leonardo

Banguera, Guillermo Fuertes

► To cite this version:

Raúl Carrasco, Manuel Vargas, Ismael Soto, Diego Fuentealba, Leonardo Banguera, et al.. Chaotic Time Series for Copper's Price Forecast. 18th International Conference on Informatics and Semiotics in Organisations (ICISO), Jul 2018, Reading, United Kingdom. pp.278-288, 10.1007/978-3-319-94541-5_28 . hal-01920732

HAL Id: hal-01920732

https://inria.hal.science/hal-01920732

Submitted on 13 Nov 2018

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
# Chaotic Time Series for Copper's Price Forecast
## Neural networks and the discovery of knowledge for big data

Raúl Carrasco¹,²[0000-0002-5023-9349], Manuel Vargas³,⁴[0000-0003-4161-6621],
Ismael Soto⁵[0000-0002-5501-5651], Diego Fuentealba⁶,⁷[0000-0001-5284-0448],
Leonardo Banguera⁸[0000-0002-0261-2372] and Guillermo Fuertes⁴[0000-0003-3044-5919]

¹ Facultad de Administración y Economía, Universidad de Santiago de Chile,
Santiago 9170022, Chile

² Facultad de Ingeniería, Ciencia y Tecnología, Universidad Bernardo O'Higgins,
Santiago 8370993, Chile

³ Departamento de Ingeniería Industrial, Universidad San Sebastián,
Santiago 8420524, Chile

⁴ Departamento de Ingeniería Industrial, Universidad de Santiago de Chile,
Santiago 9170124, Chile

⁵ Departamento de Ingeniería Eléctrica, Universidad de Santiago de Chile,
Santiago 9170124, Chile

⁶ Informatics Research Centre, University of Reading, Reading, UK

⁷ School of Informatics and Telecommunications, Universidad Tecnológica de Chile-INACAP

⁸ Department of industrial engineering, University of Guayaquil, Ecuador
{raul.carrasco.a,manuel.vargasg,ismael.soto,leonardo.banguera,
guillermo.fuertes}@usach.cl, d.a.fuentealbacid@pgr.reading.ac.uk

**Abstract.** We investigated the potential of Artificial Neural Networks (ANN), ANN to forecasts in chaotic series of the price of copper; based on different combinations of structure and possibilities of knowledge in big discovery data. Two neural network models were built to predict the price of copper of the London Metal Exchange (LME) with lots of 100 to 1000 data. We used the Feed Forward Neural Network (FFNN) algorithm and Cascade Forward Neural Network (CFNN) combining training, transfer and performance implemented functions in MatLab. The main findings support the use of the ANN in financial forecasts in series of copper prices. The copper price's forecast using different batches size of data can be improved by changing the number of neurons, functions of transfer, and functions of performance s. In addition, a negative correlation of - 0.79 was found in performance indicators using RMS and IA.

**Keywords:** Big Data, Copper Price, Chaos Theory, Neural Network, Nonlinear Systems, Time Series Forecasting.

## 1 Introduction

Copper is one of the basic metal products listed on major exchanges in the world: the LME, Commodity Exchange of New York (COMEX) and Shanghai Futures Exchange
(SHFE). Prices in these exchanges reflect the balance between the supply and demand of copper worldwide, although they may be strongly influenced by the rates of currency exchange and investment flows, factors that may cause fluctuations of volatile prices partially linked to changes in the economic cycle activity [1].

The price of copper is a sensitive issue for major producers such as Codelco, Freeport-McMoRan Copper & Gold, Glencore Xstrata, BHP Billiton, Southern Copper Corporation, American Smelting and Refining Company. Economies such as those of Chile and Zambia rely heavily on copper production and, subsequently, in the evolution of the prices of the same [2], being Chile the largest producer and exporter of the world.

Several studies include copper as one of the products of interest in the evaluations of the forecast to improve the prediction of prices. They employ a variety of different methods and mathematical models: time series [3–5], combined with wavelet [6, 7], transformed of Fourier [8], swarm optimisation algorithm [9], and models of multi-products [10].

A fairly accurate time series model could predict several years forward, whose skill is an advantage for the planning of future requirements. Research on nonlinear dynamic systems has allowed in recent years significantly improve the impact of the predictive capacity of the times series. Chaos is a universal complex dynamic phenomenon that exists in different natural and social systems such as communication, economics and biology. The auto-correlation of chaotic behaviour in the economy began in the decade of 1980, applied to macroeconomic variables such as the gross domestic product (GDP) and monetary aggregates [11]. Since then, several studies have been conducted to search chaotic behaviour in economic and financial series [12, 13].

In this context, amongst the most used techniques and tools are graphics analysis of recurrence, Temporal Space Entropy (STE) Hurst coefficient and exponent of the Lyapunov dimension of correlation for the matching of chaotic behaviour in these series [14]. Additionally, the existence of chaotic behaviour in the commodities of copper was corroborated in [15].

The motivations and the need to carry out this research is to evaluate the ANN by different dimensions, type of networks, functions and structures.

## 2 Methodology

The continuous increase of the power of calculation and availability of data has grown the attention in the use of ANN in many types of problems of prediction. The ANN can model and predict linear and nonlinear time-series with a high degree of accuracy, to capture any relationship between the data without prior knowledge of the problem which is modelled [16].

The methodology used for visual and statistical analysis is summarised according to the Fig. 1 adapted the Loshin [17].

The closing prices of copper traded on the LME were used with the different functions of learning, optimisation and transfer as input. Then, the quality of the forecast of the ANN performed in MatLab R2014a simulation tool was evaluated with Root Mean Square (RMS) and the Adequacy Index (IA). The saved data goes through the process
of Extract, Transform and Load (ETL) to be stored in the Data Warehouse (DW) in a multi-dimensional form, using SQL Server 2008. The visual analysis of the results is done by the software BI Tableau Desktop 8.3 as Frontend, and the R version 3.1.2 software to perform the corresponding statistical analysis.

<figure><img src="image_2.png" /><figcaption>Fig. 1. Methodological graph based on methodology of Business Intelligence (BI).</figcaption></figure>

## 2.1 Segmentation of Data

Data were segmented into two sizes of batches. The former with 100 and the later with thousand data. Periods from 22/01/2015 to 16/06/2015 and the 01/07/2011 to 16/06/2015 respectively.

Segmentation according to the evaluated batch records is according to the Table 1.

<table><caption>Table 1. Segmentation's Records.</caption><thead><tr><th>Batch<br>Theoretician</th><th>Training<br>First 70% of the data</th><th>Testing<br>15% next data</th><th>Verification<br>15% of the final data</th></tr></thead><tbody><tr><td>100</td><td>[1;70]</td><td>[71;85]</td><td>[86;100]</td></tr><tr><td>1000</td><td>[1;700]</td><td>[701;850]</td><td>[851;1000]</td></tr></tbody></table>

## 2.2 Artificial Neural Networks

Represented FFNN has been taken to this work in the Fig. 2(a) and the represented CFNN in the Fig. 2(b). We have selected some of the features available in the toolbox of Matlab software.

The inputs used in the system correspond to $t_{-1}$, $t_{-2}$, $t_{-3}$, $t_{-4}$, $t_{-1}$, $t_{-6}$ and target $t_0$ the copper price time series.

<figure><img src="image_3.png" /><figcaption>Fig. 2. (a) FFNN of 1-20 neurons in the hidden layer. (b) CFNN of 1-20 neurons in the hidden layer [18].</figcaption></figure>
## 2.3 Alternatives of Evaluation

The different alternatives of a network are given according to different combinations between their functions as shown in equation (1).

$$M = E * R * F * n \quad (1)$$

where,

M, It is an alternative for a network number.

E, It is the number of training functions.

R, It is the number of performance functions.

F, It is the number of transfer functions.

n, It is the number of neurons in the hidden layer.

Replacing values in the equation (1) gets the number of alternatives for a network.

$$M=9*2*3*20=1080$$

To calculate the total number of alternatives evaluated in this work is obtained from the equation (2).

$$T = M * N * L \quad (2)$$

where,

T, It is the number of evaluated alternatives.

N, It is the number of networks (structure of similar functions)

L, It is the number of batches of data.

Replacing values in the equation (2) obtained 4320 alternative evaluated in this work.

$$T = 1080 * 2 * 2 = 4320$$

Were 27 simulations for each of the 4320 alternatives evaluated in this work with a total of 116640 simulations according to the equation (3).

$$T_s = T * S \quad (3)$$

Where,

T_s, It is the total number of simulations carried out.

S, It is the number of simulations for each alternative.

## 2.4 Multidimensional Model

This research focuses on the evaluation of two networks simultaneously from different dimensions. The FFNN and the CFNN in dimRed, training features (trainbfg, traincgb, traincfg, traincgp, traingd, traingdm, traingda, traingdx, trainlm) in dimFuncTrain, in dimFuncTransfer (logsig, tansig, purelin) transfer functions, functions (mse, sse) performance in dimFuncPerform. Number them 1 to 20 neurons, with batches of 100 and 1,000 data. The function of learning was the learngdm and the metrics of evaluation [RMS, IA, bestEpoch, duration] in fact table.
Fig. 3 shows the "star model" [19] used to perform multidimensional analysis according to the methodology proposed by Ralf Kimball [20]. The construction of the DW was based on multidimensional modelling, in which the structures of the information on table are facts and dimensions [21].

<figure><img src="image_4.png" /><figcaption>Fig. 3. Star model for multidimensional analysis of project.</figcaption></figure>

## 2.5 Performance Measures

$$RMS = \sqrt{\frac{\sum_{i=1}^{n}(o_i - p_i)^2}{\sum_{i=1}^{n} o_i^2}} \qquad (4)$$

$$IA = 1 - \frac{\sum_{i=1}^{n} (o'_{i} - p'_{i})^2}{\sum_{i=1}^{n} (|o'_{i}| - |p'_{i}|)^2} \qquad (5)$$

The results were validated using performance measures that allow indicating the degree of generalisation of the model used. The indexes are the average quadratic Error (RMS), and the index of adequacy (IA). Both are shown in the equations (4) and (5), respectively, where $o_i$ and $p_i$ are the values observed and predicted respectively at the time $i$, and $N$ is the total number of data. In addition, $p'_i = p_i - o_m$ and $o'_i = o_i - o_m$, being $o_m$ value average of the observations [22].

IA indicates the degree of adjustment that has the values estimated with the actual values of a variable. A value close to 1 indicates a good estimate. On the other hand, near-zero RMS indicate a good quality setting.

# 3 Results

## 3.1 Knowledge Discovery

The knowledge is in the data, however, must be extracted and built for the consumption of the users. New technological solutions are required for data management. The new software and methodologies are the solution to make sense of the data, allowing to extract useful information for the construction of knowledge, supporting decision making. Data from markets together with the new data generated from different data mining techniques, can help to the analysis and the management of Big Data [23, 24]. In this case, the business intelligence tool enables the discovery of knowledge.

Fig. 4 shows the best results obtained in the average assessment (RMS) in lots of 100 data FFNN. The indexes are shown in a scale of colors, where the blue colour
indicates better value performances corresponding to the minimum of the RMS and the red colour lower performance. After several iterations were obtained the best results to correspond to functions purelin, traincgb, traincfg, traincgp, mse and sse between 1 and 5 neurons.

<figure><img src="image_5.png" /><figcaption>**Fig. 4.** Final result and visual analysis of the FFNN, batch =100.</figcaption></figure>

(AI) in the FFNN average assessment indicates a better fit in the curves, for this case are kept the same functions and expands the range of neurons from 1 to 20.

In the case of the FFNN network for batches of 1000 data, the best results of RMS and AI they correspond to the functions purelin, trainlm, mse and sse with ranges of neurons from 6 to 10 in Table 2.

<table><caption>**Table 2.** FFNN for batches of 1000, functions purelin, trainlm, mse and sse with ranges of neurons from 6 to 10.</caption><thead><tr><th>Perform</th><th>Neurons</th><th>RMS</th><th>IA</th></tr></thead><tbody><tr><td>mse</td><td>6</td><td>0.007682365</td><td>0.97249718</td></tr><tr><td>mse</td><td>7</td><td>0.007676144</td><td>0.972600372</td></tr><tr><td>mse</td><td>8</td><td>0.007686618</td><td>0.972512072</td></tr><tr><td>mse</td><td>9</td><td>0.007678558</td><td>0.972517947</td></tr><tr><td>mse</td><td>10</td><td>0.007682348</td><td>0.972498224</td></tr><tr><td>sse</td><td>6</td><td>0.007680212</td><td>0.972510564</td></tr><tr><td>sse</td><td>7</td><td>0.00768904</td><td>0.972449236</td></tr><tr><td>sse</td><td>8</td><td>0.007678767</td><td>0.972536585</td></tr><tr><td>sse</td><td>9</td><td>0.007675839</td><td>0.972631146</td></tr><tr><td>sse</td><td>10</td><td>0.00768069</td><td>0.972486787</td></tr></tbody></table>

In the case of CFNN for batches of 100 data, the best results for the averages of RMS and AI they correspond to the functions purelin, traincgb, traincfg, traincgp, mse and sse between 1 and 2 neurons in Table 3.

CFNN batches of 1000 data, for best results unemployment averages RMS and IA they correspond to the functions purelin, trainlm, mse and sse with ranges from 3 to 4 neurons in Table 4.

We found that FFNN and CFNN for batches of 100 data obtained the best results with the training functions named traincfg, traincgb, and traincgp. On the other hand, for batches of 1000 data, the best function of training was the trainlm in FFNN and CFNN.
<table><caption>**Table 3.** CFNN for batches of 100, purelin, traincgb, traincfg, traincgp, mse and sse between 1 and 2 neurons functions.</caption><thead><tr><th rowspan="2">trainFcn</th><th rowspan="2">n</th><th>Mse</th><th>mse</th><th>sse</th><th>sse</th></tr><tr><th>RMS</th><th>IA</th><th>RMS</th><th>IA</th></tr></thead><tbody><tr><td>traincgb</td><td>1</td><td>0.008416036</td><td>0.999978052</td><td>0.008722153</td><td>0.999976384</td></tr><tr><td>traincgb</td><td>2</td><td>0.008596207</td><td>0.999977127</td><td>0.008489567</td><td>0.999977647</td></tr><tr><td>traincfg</td><td>1</td><td>0.008737803</td><td>0.999976242</td><td>0.008464134</td><td>0.99997776</td></tr><tr><td>traincfg</td><td>2</td><td>0.008556195</td><td>0.999977299</td><td>0.008739409</td><td>0.999976321</td></tr><tr><td>traincgp</td><td>1</td><td>0.008581721</td><td>0.999977098</td><td>0.008644758</td><td>0.999976784</td></tr><tr><td>traincgp</td><td>2</td><td>0.008634526</td><td>0.999976813</td><td>0.008536383</td><td>0.999977431</td></tr></tbody></table>

<table><caption>**Table 4.** CFNN for 1000 batches, functions purelin, trainlm, mse and sse with ranges from 3 to 5 neurons.</caption><thead><tr><th>Perform</th><th>Neurons</th><th>RMS</th><th>IA</th></tr></thead><tbody><tr><td>mse</td><td>3</td><td>0.007678561</td><td>0.972558102</td></tr><tr><td>mse</td><td>4</td><td>0.007684607</td><td>0.972423949</td></tr><tr><td>mse</td><td>5</td><td>0.007675506</td><td>0.972534376</td></tr><tr><td>sse</td><td>3</td><td>0.007670738</td><td>0.972539376</td></tr><tr><td>sse</td><td>4</td><td>0.007681384</td><td>0.972468666</td></tr><tr><td>sse</td><td>5</td><td>0.007683084</td><td>0.97254968</td></tr></tbody></table>

## 3.2 Forecast

The charts show the forecast made by the FFNN and chaotic CFNN in series of the copper's price (Fig. 5a, Fig. 5b, Fig. 5c and Fig. 5d). FFNN and CFNN show similar values in his performance's ratings.

## 3.3 Statistic Analysis

The CFNN (trainFcn = trainlm, performFcn = mse, transferFcn = purelin, learnFcn = learningdm, lot = 1000, numNeuronas = 3) simulo up to 10000 simulations, where obtained good results in the performance of the network, with average measures of RMS of 0.00767957, IA of 0.9725127 and best_epoch of 3.1376; minimum values of 0.007535554; 0.9698627 and 1 respectively, maximum values of 0.007712344; 0.9731063 and 11 respectively, in the Table 5 the statistical summary of the simulation.

To review the distribution of RMS performance measures is observed which is skewed to the left Fig. 6 a, Therefore, the bias is negative (less than the median average); Instead the IA is skewed to the right index Fig. 6 b, therefore, the bias is positive (greater than the median average) and the best_epoch this biased right in Fig. 6 c. On the other hand the correlations (Pearson) graph shows a high negative correlation of -0.79 between RMS and the IA which shows the good performance of the ANN indicated by RMS will also be according to the IA. On the other hand presents a negative
correlation of - 0.49 between IA and best_epoch; and a positive correlation of 0.52 between RMS and best_epoch.

<table><caption>**Table 5.** Statistical simulation.</caption><thead><tr><th>Perform</th><th>RMS</th><th>IA</th><th>best_epoch</th></tr></thead><tbody><tr><td>mean</td><td>0.00767957</td><td>0.9725127</td><td>3.1376</td></tr><tr><td>sd</td><td>0.00002461</td><td>0.000225216</td><td>1.417486</td></tr><tr><td>min</td><td>0.007535554</td><td>0.9698627</td><td>1</td></tr><tr><td>25%</td><td>0.007671562</td><td>0.9723753</td><td>2</td></tr><tr><td>50%</td><td>0.007693985</td><td>0.9723813</td><td>3</td></tr><tr><td>75%</td><td>0.007694727</td><td>0.9726121</td><td>4</td></tr><tr><td>max</td><td>0.007712344</td><td>0.9731063</td><td>11</td></tr><tr><td>n</td><td>1000</td><td></td><td></td></tr></tbody></table>

<figure><img src="image_6.png" /><figcaption>**Fig. 5.** a)Forecast of the FFNN for data verification with lot of 100, purelin, traincgp and sse of 5 neurons functions; b) Forecast of the FFNN for data verification with lot of 1000, purelin, trainlm and sse of 7 neurons functions; c) Forecast of CFNN for data verification with lot of 100, purelin, traincgb and sse of 1 neurons functions; d) Forecast of CFNN for data verification with lot of 1000, purelin, trainlm and mse of 3 neurons functions.</figcaption></figure>

# 4 Conclusions

Forecasts based on neural network, nonlinear models achieved better results compared with linear forecasting models. Combinations of two neural network models, with nine training functions, two functions of performance, lots of 100 to 1000 data and ranges from 1 to 20 neurons and three transfer functions have been studied.
<figure><img src="image_7.png" /><figcaption>**Fig. 6.** a) distribution of RMS, b) distribution of IA, c) distribution of best_epoch and d) Plot of correlations between IA and RMS best_epoch.</figcaption></figure>

For different batch size of data it is to be more sensitive to the functions of training on the functions of transfer, performance, number of neurons.

The results of the simulations predict in the case of the copper price series; the best combinations of functions are vector (trainFcn = trainlm, performFcn = mse, transferFcn = purelin, learnFcn = learngdm, lot = 1000, number neurons = 3) for batch 1000 network CFNN and vector (trainFcn = traincgp, performFcn = mse, transferFcn = purelin, learnFcn = learngdm, lot = 100, numNeuronas = 1) to the FFNN.

Found a high negative correlation of - 0.79 in the performance indicators used RMS e IA.

In future work, it is necessary to review the contribution of other macroeconomic variables in the performance of the model, in particular, market of capitals of other commodities.

Finally, the characteristics of these time series, should be analysed the same set of combinations of functions in other economic series of price, to assess the possible relationships of the systems involved.

**Acknowledgment.** The authors are acknowledgment the financing of the project “Multiuser VLC for underground mining”, code: IT17M10012 and this research has been supported by DICYT (Scientific and Technological Research Bureau) of The University of Santiago of Chile (USACH) and Department of Industrial Engineering.

## References

1. Roberts, M.C.: Duration and characteristics of metal price cycles. Resour. Policy. 34, 87–102 (2009).

2. Sánchez Lasheras, F., de Cos Juez, F.J., Suárez Sánchez, A., Krzemień, A., Riesgo Fernández, P.: Forecasting the COMEX copper spot price by means of neural networks and ARIMA models. Resour. Policy. 45, 37–43 (2015).

3. Dooley, G., Lenihan, H.: An assessment of time series methods in metal price forecasting. Resour. Policy. 30, 208–217 (2005).

4. Carrasco, R., Astudillo, G., Soto, I., Chacon, M., Fuentealba, D.: Forecast of copper price series using vector support machines. In: 2018 7th International Conference on Industrial Technology and Management (ICITM). pp. 380–384. IEEE (2018).

5. Seguel, F., Carrasco, R., Adasme, P., Alfaro, M., Soto, I.: A Meta-Heuristic approach for copper price forecasting. (2015).
6. Kriechbaumer, T., Angus, A., Parsons, D., Rivas Casado, M.: An improved wavelet-ARIMA approach for forecasting metal prices. Resour. Policy. 39, 32–41 (2014).

7. Goss, B.A., Avsar, S.G.: Simultaneity, forecasting and profits in London copper futures. Aust. Econ. Pap. 52, 79–96 (2013).

8. Khalifa, A., Miao, H., Ramchander, S.: Return distributions and volatility forecasting in metal futures markets: Evidence from gold, silver, and copper. J. Futur. Mark. 31, 55–80 (2011).

9. Ma, W., Zhu, X., Wang, M.: Forecasting iron ore import and consumption of China using grey model optimized by particle swarm optimization algorithm. Resour. Policy. 38, 613–620 (2013).

10. Cortazar, G., Eterovic, F.: Can oil prices help estimate commodity futures prices? The cases of copper and silver. Resour. Policy. 35, 283–291 (2010).

11. Lebaron, B.: Chaos and nonlinear forecastability in economics and finance. Philos. Trans. Phys. Sci. Eng. 348, 397–404 (1994).

12. Los, C.A.: Visualization of chaos for finance majors. EconWPA (2004).

13. Los, C.A., Yu, B.: Persistence characteristics of the Chinese stock markets. Int. Rev. Financ. Anal. 17, 64–82 (2008).

14. Espinosa, C.: Caos en el mercado de commodities. Cuad. Econ. 29, 155–177 (2010).

15. Carrasco, R., Vargas, M., Alfaro, M., Soto, I., Fuertes, G.: Copper Metal Price Using Chaotic Time Series Forecasting. IEEE Lat. Am. Trans. 13, 1961–1965 (2015).

16. Kourentzes, N., Barrow, D.K., Crone, S.F.: Neural network ensemble operators for time series forecasting. Expert Syst. Appl. 41, 4235–4244 (2014).

17. Loshin, D.: Chapter 5 – The Business Intelligence Environment. In: Loshin, D. (ed.) Business Intelligence. pp. 61–76. Morgan Kaufmann (2013).

18. MathWorks: MatLab 2014a, (2014).

19. Howson, C.: Successful Business Intelligence: Secrets to Making BI a Killer App [Hardcover]. McGraw-Hill Osborne Media, New York (2007).

20. Sherman, R.: Chapter 6 - Data architecture. In: Business Intelligence Guidebook. pp. 107–142. Morgan Kaufmann, Boston (2015).

21. Soler, E., Trujillo, J., Fernández-Medina, E., Piattini, M.: Building a secure star schema in data warehouses by an extension of the relational package from CWM. Comput. Stand. Interfaces. 30, 341–350 (2008).

22. Zambrano Matamala, C., Rojas Díaz, D., Carvajal Cuello, K., Acuña Leiva, G.: Análisis de rendimiento académico estudiantil usando data warehouse y redes neuronales. Ingeniare. Rev. Chil. Ing. 19, 369–381 (2011).

23. Xhafa, F., Taniar, D.: Big data knowledge discovery. Knowledge-Based Syst. 79, 1–2 (2015).

24. Lagos, C., Carrasco, R., Fuertes, G., Gutiérrez, S., Soto, I., Vargas, M.: Big Data on Decision Making in Energetic Management of Copper Mining. Int. J. Comput. Commun. Control. 12, 61–75 (2017).