# Storage and Processing of Big Data for Geomagnetic Support of Directional Drilling
## 1 Introduction  
With respect to the widespread implementation of modern satellite positioning technologies (such as global navigation satellite systems or GNSSs), the Earth's magnetic field (EMF) remains one of the main reliable natural geophysical fields used for the navigation and orientation of artificial objects. An important feature of the geomagnetic method is the capability of the instant determination of an object's orientation. GNSSs allow us to determine the position or direction of a moving object. To determine the orientation of an object requires additional technical solutions, so magnetic navigation is still a necessary backup, and sometimes the only possible method, e.g., the magnetic compass remains an essential element of equipment and instrumentation used for the navigation of vehicles [1; 2; 3; 4]. Among the applications of geomagnetic referencing and navigation is support of the mining industry. The extraction of hard-to-recover oil and gas deposits, as well as of the hydrocarbon deposits located at high latitudes, necessitates the implementation of more complex well-drilling technologies. The impossibility of using GNSSs for underground positioning stipulates the application of inertial systems for drill navigation and positioning using geophysical fields, including EMFs [5; 6]. The oil depletion in conventional reservoirs has expanded the scope of drilling to include unconventional reservoirs [7]. To develop such reservoirs, it is necessary to use complex extraction technologies. One of these advanced extraction technologies is the method of directional drilling (DD) [8], which is widely used in modern oil and gas exploration practice. This approach entails the drilling of long wells, almost horizontally entering the oil deposit. One of the main methods of underground orientation is geomagnetic referencing using vector magnetometers installed directly on the drilling instrument. The length of the well in this case can vary from 4-5 km to more than 10 km. This process is considered high-tech largely because of the complex spatial profile of the borehole in the multilateral direction [9]. The problem of supporting navigation accuracy improvement in directional drilling has been attracting the attention of researchers for several decades [10; 11]. In 1999, an international professional community--the Industry Steering Committee on Wellbore Survey Accuracy (ISCWSA, [[https://www.iscwsa.net/](https://www.iscwsa.net/)]([https://www.iscwsa.net/](https://www.iscwsa.net/)) (accessed on 3 September 2024)), was founded to create and develop standards for precise navigation while drilling. It united the amassed world's experience in underground navigation and became an independent center for the standardization of technologies and algorithms. Over these years, the industry has evolved from low-resolution main field models to using data from a nearby magnetic observatory, referred to as interpolated in-field referencing (IIFR). IIFR is a complement to high-resolution (decomposition degree greater than 720) models of the full EMF and is included in the international ISCWSA standard. The development of navigation technologies for drilling has opened up a number of knowledge-intensive tasks in the field of new approaches to detecting local magnetic anomalies using ground and UAV surveys [10; 12], the field of high-precision modeling of the EMF using spherical harmonics, and that of monitoring the magnetosphere dynamics in real time [13; 14]. The problem of geomagnetic data application in the practice of DD has been discussed [11; 15; 16; 17], and it was shown that it requires high-precision up-to-date data on EMF spatiotemporal variations and relevant analytical methods and instruments. The emerged challenges have received a wide response in the scientific community in the form of high-precision EMF models [18; 19].