Storage and Processing of Big Data for Geomagnetic Support of Directional Drilling
Source abstract
Abstract
Modern satellite positioning and navigation technologies are not applicable in specific areas such as the exploration of oil and gas deposits by means of directional drilling techniques. Here, we can rely solely on natural geophysical fields, such as the Earth’s magnetic field. The precise underground navigation of borehole drilling instruments requires a seamless, near-real-time access to operational geomagnetic data. This paper describes the MAGNUS BD hardware-software system, deployed at the Geophysical Center of the Russian Academy of Sciences, that provides the efficient accumulation, storage, and processing of geomagnetic data. This system, based on the Big Data (BD) technology, is a modern successor of the MAGNUS processing software complex developed in 2016. MAGNUS BD represents one of the first cases of the BD technology’s application to geomagnetic data. Its implementation provided a significant increase in the speed of information processing and allowed for the use of high-frequency geomagnetic satellite data and expanding the overall functionality of the system. During the MAGNUS BD system’s deployment on a physically separate dedicated cluster, the existing classical database (DB) was migrated to the Arenadata database with full preservation of its functionality. This paper gives a brief analysis of the current problems of directional drilling geomagnetic support and outlines the possible solutions using the MAGNUS BD system.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Geological Modeling and Analysis · Image Processing and 3D Reconstruction · Advanced Computational Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Geophysical Center of the Russian Academy of Sciences (GC RAS), 119296 Moscow, Russia
Schmidt Institute of Physics of the Earth of the Russian Academy of Sciences (IPE RAS), 123242 Moscow, Russia
Funding
Geophysical Center of RAS · Schmidt Institute of Physics of the Earth of RAS · Ministry of Science and Higher Education of the Russian Federation
References (40)
Show source-provided references
1. Navigation of ground vehicles using magnetic field variations10.1002/navi.70 ↗
2. The use of magnetic field and magnetometers in supporting the air navigation10.1515/aon-2015-0018 ↗
3. Magnetic Field Based Positioning Systems10.1109/COMST.2017.2684087 ↗
4. An indoor fusion navigation algorithm using HV-derivative dynamic time warping and the chicken particle filter10.1186/s43020-022-00073-3 ↗
5. Accuracy Prediction for Directional Measurement While Drilling10.2118/67616-PA ↗
6. Geomagnetic Referencing—The Real-Time Compass for Directional Drillers
7. Li, Q., Li, Q., Wang, F., Wu, J., and Wang, Y. (2024). The Carrying Behavior of Water-Based Fracturing Fluid in Shale Reservoir Fractures and Molecular Dynamics of Sand-Carrying Mechanism. Processes, 12.10.3390/pr12092051 ↗
8. Gooneratne, C.P., Li, B., Deffenbaugh, M., and Moellendick, T. (2019). Instruments, Measurement Principles and Communication Technologies for Downhole Drilling Environments, Springer International Publishing.10.1007/978-3-030-04900-3 ↗
9. Short, J.A. (1993). Introduction to Directional and Horizontal Drilling, PennWell Publishing.
10. Williamson, H.S., Gurden, P.A., Kerridge, D.J., and Shiells, G. (1998, January 27–30). Application of Interpolation In-Field Referencing to Remote Offshore Locations. Proceedings of the SPE Annual Technical Conference and Exhibition, New Orleans, LA, USA.10.2118/49061-MS ↗
11. Poedjono, B., Beck, N., Buchanan, A., Brink, J., Longo, J., Finn, C.A., and Worthington, E.W. (2011). Geomagnetic Referencing in the Arctic Environment. SPE Arctic and Extreme Environments Technical Conference and Exhibition, SPE.10.2118/149629-RU ↗
12. Prospects of Using Unmanned Aerial Vehicles in Geomagnetic Surveys10.3103/S0747923920050059 ↗
13. Poedjono, B., Maus, S., and Manoj, C. (2014, January 7–9). Effective Monitoring of Auroral Electrojet Disturbances to Enable Accurate Wellbore Placement in the Arctic. Proceedings of the OTC Arctic Technology Conference, Houston, TX, USA.10.4043/24583-MS ↗
14. The USGS Geomagnetism Program and Its Role in Space Weather Monitoring10.1029/2011SW000684 ↗
15. Geomagnetic Referencing Techniques as Vital Directional Reference in Hydrocarbon Drilling
16. Estimating the influence of geomagnetic disturbances on the trajectory of the directional drilling of deep wells in the Arctic region10.1134/S1069351318040055 ↗
17. On the need for accurate monitoring of the geomagnetic field during directional drilling in the Russian Arctic10.1134/S1069351322020124 ↗
18. Nair, M., Chulliat, A., Woods, A., Alken, P., Meyer, B., Poedjono, B., Zachman, N., and John, H. (2021, January 16–19). Next Generation High-Definition Geomagnetic Model for Wellbore Positioning, Incorporating New Crustal Magnetic Data. Proceedings of the Offshore Technology Conference, Virtual and Houston, TX, USA.10.4043/31044-MS ↗
19. Maus, S., Nair, M.C., Poedjono, B., Okewunmi, S., Fairhead, D., Barckhausen, U., Milligan, P.R., and Matzka, J. (2012, January 6–8). High Definition Geomagnetic Models: A New Perspective for Improved Wellbore Positioning. Proceedings of the IADC/SPE Drilling Conference and Exhibition, San Diego, CA, USA.10.2118/151436-MS ↗
20. Nair, M., Woods, A., Chulliat, P.A., and Boneh, N. (2015, January 1). A real-time magnetic disturbance model to improve drilling accuracy in low and mid latitudes of the Earth. Proceedings of the Industry Steering Committee on Wellbore Survey Accuracy (ISCWSA), Houston, TX, USA. Available online: https://www.iscwsa.net/media/files/files/73a6da7c/06-isc42-real-time-magnetic-disturbance.pdf.
21. Turbitt, C.W., and Clark, T.D.G. (1994). The Use of Lerwick Variometer Measurements to Estimate Magnetic Disturbances over the North Sea, British Geological Survey. Technical Report WM/94/21C.
22. Russell, J.P., Shiells, G., and Kerridge, D.J. (1995). Reduction of wellbore positional uncertainty through application of a new geomagnetic in-field referencing technique. SPE Annual Technical Conference and Exhibition, SPE. Technical Paper SPE-30452-MS.10.2118/30452-MS ↗
23. Momot, F., Humbled, F., Garbers, M., Shabanov, S., Gonsette, A., Sikal, A., Cousso, O., and Reynaud, D. (2019, January 26–28). First Onsite Automatic Geomagnetic Observatory Improves Well-Bore Positioning. Proceedings of the International Petroleum Technology Conference, Beijing, China.10.2523/19395-MS ↗
24. Mitkus, A., Maus, S., Willerth, M., Reetz, A., Oskarsen, R.T., Emilsen, M.H., and Gergerechi, A. (2019, January 5–7). Challenges and Solutions for Accurate Wellbore Placement in the Barents Sea. Proceedings of the SPE/IADC International Drilling Conference and Exhibition, Hague, The Netherlands.10.2118/194067-MS ↗
25. Gubbins, D., and Herrero-Bervera, E. (2007). Observatories, overview. Encyclopedia of Geomagnetism and Paleomagnetism, Springer.10.1007/978-1-4020-4423-6 ↗
26. (2024, September 15). International Geomagnetic Reference Field (IGRF). Available online: https://geomag.bgs.ac.uk/research/modelling/IGRF.html.
27. International Geomagnetic Reference Field: The thirteenth generation10.1186/s40623-020-01288-x ↗
28. Space weather effects on drilling accuracy in the North Sea10.5194/angeo-23-3081-2005 ↗
29. A Proper use of the adjacent land-based observatory magnetic field data to account for the geomagnetic disturbances during offshore directional drilling10.1029/2022SW003238 ↗
30. Advanced production of quasi-definitive magnetic observatory data of the INTERMAGNET standard10.1134/S0016793221010096 ↗
31. Automated Hardware and Software System for Monitoring the Earth’s Magnetic Environment10.5334/dsj-2016-018 ↗
32. Observatory data and the Swarm mission10.5047/eps.2013.07.011 ↗
33. Big data in Earth science: Emerging practice and promise10.1126/science.adh9607 ↗
34. Systems Analysis of Big Data for Earth Sciences
35. Application of artificial intelligence and the future of big data analytics in the mining industry
36. Big Data normalization for massively parallel processing databases10.1016/j.csi.2017.01.009 ↗
37. Implementation of Database Massively Parallel Processing System to Build Scalability on Process Data Warehouse10.1016/j.procs.2018.08.151 ↗
38. Drilling speed–the relevance of experience10.1016/j.eneco.2011.11.016 ↗
39. Increasing drilling speed in long horizontal intervals in Aktobe Kazakstan10.1088/1755-1315/300/2/022029 ↗
40. Database of geomagnetic observations in Russian Arctic and its application for estimates of the space weather impact on technological systems