# Storage and Processing of Big Data for Geomagnetic Support of Directional Drilling
## 5 Discussion  
The capabilities of systems built on the basis of BD have properties in common with the classical data storage and processing systems. The main advantages of BD systems lie in several aspects. Firstly, as shown above, there is a manyfold increase in the speed of query processing in BD-oriented systems compared to classical approaches. Such data processing speeds cannot be achieved by simply increasing the power of the computer, i.e., vertical scaling. The latter method is effective only up to a certain limit. At the same time, the costs of information processing grow exponentially, as a direct consequence of the strengthening of the used computing systems and technologies. At a certain point, the maximum cost value can be reached. The employment of a BD-oriented approach in such a situation allows one to strengthen the system by using standard server solutions. In the system's application to geomagnetic data, this allows one to quickly and repeatedly scale the MAGNUS BD system, accepting information from new observatories and satellites as well as expanding the range of data by adding new types of information. In their theoretical basis, BD technologies are based on the involvement of large arrays of information in their processing. They allow identifying information about the  
Figure 8: Declination and inclination of the \(B\) vector during the magnetic storm of 1–3 December according to the Klimovskaya magnetic observatory (KLI) (**a**), correction error via MAGNUS (**b**), correction error via MAGNUS BD (**c**). The lines on the graphs (**b**,**c**) show the thresholds of the ISCWSA error requirements: 1\(\sigma\) (green), 2\(\sigma\) (orange), 3\(\sigma\) (red). study object at a qualitatively different level, including recognizing previously unknown and even unexpected dependencies [34]. In practice, this is realized by the joint use of \"hot\" and \"cold\" data in the work carried out using this type of system. Within the framework of the MAGNUS BD project, \"hot\" data include information about the state of the Earth's magnetic field, recorded in the modern, generally accepted IAGA format (depth of 5-15 years, depending on the observatory). \"Cold\" is an array of available observatory records in binary format, including satellite and historical data. The use of the unified MAGNUS BD system will provide more efficient solutions to a scope of applied problems which require non-trivial mathematical algorithms for processing geomagnetic data, the multi-criteria assessment of geophysical parameters, and the involvement of GIS technologies. An example of such an applied problem is the choice of a site for the construction of a new magnetic observatory to support directional drilling. When solving this problem, it is necessary to take into account a large number of different groups of geophysical and infrastructure parameters. The first group of parameters includes the values of lithospheric magnetic anomalies, the geological and tectonic structure of the territory, and the locations of existing observatories. The infrastructure group of criteria includes the locations of current and promising sites for the extraction of hard-to-recover reserves, the availability of electricity, and transport accessibility. The choice is made under conditions of strict constraints on the minimum distance to sources of electromagnetic noise such as populated areas, industrial facilities, high-voltage power lines, railways and highways, and runways. Another urgent task is the construction and updating of high-resolution models of the geomagnetic field for the purposes of directional drilling. Its modeling is based on continuous work with current ground and satellite information, which is Big Data by definition. On the other hand, the construction of new models of the geomagnetic field is traditionally based on a comparative analysis with existing models and verification using ground-based observatory data [40].