journal article·2020-03-11Open access

An Overview on the Latest Nature-Inspired and Metaheuristics-Based Image Registration Algorithms

J. Santamaría, M. L. Rivero-Cejudo, M. A. Martos-Fernández, F. Roca

Applied Sciences· Volume 10· Issue 6

Abstract

The development of automated image registration (IR) methods is a well-known issue within the computer vision (CV) field and it has been largely addressed from multiple viewpoints. IR has been applied to a high number of real-world scenarios ranging from remote sensing to medical imaging, artificial vision, and computer-aided design. In the last two decades, there has been an outstanding interest in the application of new optimization approaches for dealing with the main drawbacks present in the early IR methods, e.g., the Iterative Closest Point (ICP) algorithm. In particular, nature-inspired computation, e.g., evolutionary computation (EC), provides computational models that have their origin in evolution theories of nature. Moreover, other general purpose algorithms known as metaheuristics are also considered in this category of methods. Both nature-inspired and metaheuristic algorithms have been extensively adopted for tackling the IR problem, thus becoming a reliable alternative for optimization purposes. In this contribution, we aim to perform a comprehensive overview of the last decade (2009–2019) regarding the successful usage of this family of optimization approaches when facing the IR problem. Specifically, twenty-four methods (around 16 percent) of more than one hundred and fifty different contributions in the state-of-the-art have been selected. Several enhancements have been accordingly provided based on the promising outcomes shown by specific algorithmic designs. Finally, our research has shown that the field of nature-inspired and metaheuristic algorithms has increased its interest in the last decade to address the IR problem, and it has been highlighted that there is still room for improvement.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image and Video Retrieval Techniques · Robotic Path Planning Algorithms · Robotics and Sensor-Based Localization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, University of Jaén, 23071 Jaén, Spain

Applied Computational Engineering Research Group, University of Jaén, 23071 Jaén, Spain

Department of Mathematics, University of Jaén, 23071 Jaén, Spain

References (75)

Show source-provided references
1. Least-squares fitting of two 3-D points sets10.1109/TPAMI.1987.4767965 ↗
2. Image registration methods: A survey10.1016/S0262-8856(03)00137-9 ↗
3. A comparative study of state-of-the-art evolutionary image registration methods for 3D modeling10.1016/j.cviu.2011.05.006 ↗
4. A Qualitative Review on 3D Coarse Registration Methods10.1145/2692160 ↗
5. A method for registration of 3D shapes10.1109/34.121791 ↗
6. Improving ICP with easy implementation for free form surface matching10.1016/S0031-3203(03)00239-5 ↗
7. Soft Computing and Fuzzy Logic10.1109/52.329401 ↗
8. De Jong, K. (2002). Evolutionary Computation, The MIT Press.
9. Ghosh, A., and Tsutsui, S. (2003). Scatter Search. Advances in Evolutionary Computation: Theory and Applications, Springer.10.1007/978-3-642-18965-4 ↗
10. Special issue on recent advances in soft computing in image processing10.1016/j.ijar.2008.02.003 ↗
11. Olague, G. (2016). Evolutionary Computer Vision, Springer.10.1007/978-3-662-43693-6 ↗
12. A Survey on Nature-Inspired Medical Image Analysis: A Step Further in Biomedical Data Integration10.3233/FI-2020-1887 ↗
13. Rusinkiewicz, S., and Levoy, M. (June, January 28). Efficient variants of the ICP algorithm. Proceedings of the Third International Conference on 3D Digital Imaging and Modeling (3DIM’01), Quebec City, QC, Canada.
14. Special issue on New Advances in 3D Imaging and Modeling10.1016/j.cviu.2009.09.007 ↗
15. Falco, I.D., Scafuri, U., Tarantino, E., Cioppa, A.D., Yetongnon, K., Dipanda, A., DePietro, R., and Gallo, L. (December, January 28). Fast Range Image Registration by an Asynchronous Adaptive Distributed Differential Evolution. Proceedings of the 2016 12TH International Conference on Signa-Image Technology & Internet-Based Systems (SITIS), Naples, Italy.
16. Silva, L., Bellon, O.R.P., and Boyer, K.L. (2005). Robust Range Image Registration Using Genetic Algorithms and the Surface Interpetenetration Measure, World Scientific.10.1142/9789812563125 ↗
17. A new genetic-based technique for matching 3D curves and surfaces10.1016/S0031-3203(99)00060-6 ↗
18. Jong, K.A.D. (2016). Evolutionary Computation: A Unified Approach, MIT Press.
19. Gendreau, M., and Potvin, J.Y. (2010). Handbook of Metaheuristics, Springer Publishing Company, Incorporated.10.1007/978-1-4419-1665-5 ↗
20. Eberhart, R., Shi, Y., and Kennedy, J. (2001). Swarm Intelligence, Morgan Kaufmann.
21. Simon, D. (2013). Evolutionary Optimization Algorithms, Wiley.
22. Schwefel, H. (1993). Evolution and Optimum Seeking: The Sixth Generation, John Wiley & Sons, Inc.
23. Marti, R., Panos, P., and Resende, M.G.C. (2016). Handbook of Heuristics, Springer.10.1007/978-3-319-07153-4 ↗
24. Corne, D., Dorigo, M., and Glover, F. (1999). An introduction to differential evolution. New Ideas in Optimization, McGraw-Hill.
25. Differential evolution—A simple and efficient heuristic for global optimization over continuous spaces10.1023/A:1008202821328 ↗
26. Memetic Computation—Past, Present & Future10.1109/MCI.2010.936309 ↗
27. Clerc, M. (2006). Particle Swarm Optimization, ISTE Publishing Company.10.1002/9780470612163 ↗
28. Biochemical parameter estimation vs. benchmark functions: A comparative study of optimization performance and representation design10.1016/j.asoc.2019.105494 ↗
29. Lozano, J.A., Larrañaga, P., Inza, I., and Bengotxea, E. (2006). Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms, Springer.10.1007/11007937 ↗
30. Membrane computing and image processing: A short survey10.1007/s41965-018-00002-x ↗
31. Bhattacharjee, K., Naskar, N., Roy, S., and Das, S. (2018). A survey of cellular automata: Types, dynamics, non-uniformity and applications. Nat. Comput., 1–29.10.1007/s11047-018-9696-8 ↗
32. Biomimicry of bacterial foraging for distributed optimization and control
33. A survey on the applications of artificial bee colony in signal, image, and video processing10.1007/s11760-015-0758-4 ↗
34. Fitzpatrick, J., Grefenstette, J., and Gucht, D. (1984, January 8–11). Image registration by genetic search. Proceedings of the IEEE Southeast Conference, Louisville, KY, USA.
35. Medical Image Registration Using Evolutionary Computation: A Survey10.1109/MCI.2011.942582 ↗
36. Performance evaluation of memetic approaches in 3D reconstruction of forensic objects10.1007/s00500-008-0351-7 ↗
37. 3D Face Recognition using Simulated Annealing and the Surface Interpenetration Measure10.1109/TPAMI.2009.14 ↗
38. Precision range image registration using a robust surface interpenetration measure and enhanced genetic algorithms10.1109/TPAMI.2005.108 ↗
39. Evolutionary tabu search strategies for the simultaneous registration of multiple atomic structures in cryo-EM reconstructions10.1016/j.jsb.2009.12.028 ↗
40. Maia, J., Barreto, G., and Coelho, A. (2010, January 28–30). Image Registration by the Extended Evolutionary Self-Organizing Map. Proceedings of the ESANN 2010—European Symposium on Artificial Neural Networks, Bruges, Belgium.
41. Maia, J., Coelho, A., and Barreto, G. (2009, January 1–5). Directly Optimizing Topology-Preserving Maps with Evolutionary Algorithms: A Comparative Analysis. Proceedings of the International Conference on Neural Information Processing, Bangkok, Thailand.10.1007/978-3-642-02490-0_143 ↗
42. Affine-based registration of CT and MR modality images of human brain using multiresolution approaches: Compaative study on genetic algorithm and particle swarm optimization10.1007/s00521-010-0374-8 ↗
43. GRASP and path relinking hybridizations for the point matching-based image registration problem10.1007/s10732-011-9166-2 ↗
44. GRASP and Path Relinking for the MAX-MIN Diversity Problem10.1016/j.cor.2008.05.011 ↗
45. MRI simulation-based evaluation of image-processing and classification methods10.1109/42.816072 ↗
46. Super-resolution registration using tissue-classified distance fields10.1109/TMI.2005.862151 ↗
47. Yang, Z., Vegh, V., Reutens, D., Chen, Q., Li, Y., Zhang, T., and Wang, L. (2012, January 16–18). A Fast Multi-resolution Differential Evolution Method for Multimodal Image Registration. Proceedings of the 2012 5TH International Congress on Image and Signal Proccessing (CISP), Chongqing, China.10.1109/CISP.2012.6469991 ↗
48. Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems10.1109/TEVC.2006.872133 ↗
49. Self-Adaptive Evolution Toward New Parameter Free Image Registration Methods10.1109/TEVC.2012.2209890 ↗
50. Variable neighborhood search10.1016/S0305-0548(97)00031-2 ↗
51. Castro, E.D., and Timmis, J. (2002). Artificial Immune Systems: A New Computational Intelligence Approach, Springer.
52. Alderliesten, T., Sonke, J., Bosman, P., Ourselin, S., and Haynor, D. (2013, January 13). Deformable image registration by multi-objective optimization using a dual-dynamic transformation model to account for large anatomical differences. Proceedings of the SPIE Medical Imaging 2013: Image Processing, Lake Buena Vista, FL, USA.10.1117/12.2006783 ↗
53. Quality time-of-flight range imaging for feature-based registration using bacterial foraging Quality time-of-flight range imaging for feature-based registration using bacterial foraging10.1016/j.asoc.2012.08.041 ↗
54. Ma, W., Fan, X., Wu, Y., and Jiao, L. (2014). An Orthogonal Learning Differential Evolution Algorithm for Remote Sensing Image Registration. Math. Prob. Eng.10.1155/2014/305980 ↗
55. Falco, I.D., Cioppa, A.D., Maisto, D., Scafuri, U., and Tarantino, E. (2014, January 12–16). Using an Adaptive Invasion-based Model for Fast Range Image Registration. Proceedings of the GECCO’14—2014 Genetic and Evolutionary Computation Conference, Vancouver, BC, Canada.
56. Pirpinia, K., Alderliesten, T., Sonke, J., Bosman, M.V.H.P., and Silva, S. (2015, January 11–15). Diversifying Multi-Objective Gradient Techniques and their Role in Hybrid Multi-Objective Evolutionary Algorithms for Deformable Medical Image Registration. Proceedings of the GECCO’15—2015 Genetic and Evolutionary Computation Conference, Madrid, Spain.10.1145/2739480.2754719 ↗
57. A comparative study on the application of advanced bacterial foraging models to image registration10.1016/j.ins.2014.10.018 ↗
58. Adaptive computational chemotaxis in bacterial foraging optimization: an analysis10.1109/TEVC.2009.2021982 ↗
59. Non-rigid multi-modal medical image registration by combining L-BFGS-B with cat swarm optimization10.1016/j.ins.2014.10.051 ↗
60. Li, T., Pan, Q., Gao, L., Li, W., Li, P., Shen, W., Liu, X., Yang, C., Barthes, J., and Luo, J. (2016, January 4–6). Normal Histogram-based Fruit Fly Optimization Algorithm for Range Image Registration. Proceedings of the IEEE 20th International Conference on Computer Supported Cooperative Work in Design (CSCWD), Nanchang, China.10.1109/CSCWD.2016.7566014 ↗
61. Qin, Y., Hu, H., Shi, Y., Liu, Y., Gao, H., Chen, J., and Zhao, Q. (2016, January 27–29). An Artificial Bee Colony Algorithm Hybrid with Differential Evolution for Multi-temporal Image Registration. Proceedings of the 35th Chinese Control Conference 2016, Chengdu, China.10.1109/ChiCC.2016.7553778 ↗
62. Biomedical Image Registration by Means of Bacterial Foraging Paradigm10.15837/ijccc.2016.3.1860 ↗
63. Bouter, A., Alderliesten, T., Bosman, P., Styner, M., and Angelini, E. (2017, January 24). A novel model-based evolutionary algorithm for multi-objective deformable image registration with content mismatch and large deformations: benchmarking efficiency and quality. Proceedings of the SPIE Medical Imaging 2017: Image Processing, Orlando, FL, USA.10.1117/12.2254144 ↗
64. A novel evolutionary rigid body docking algorithm for medical image registration10.1016/j.swevo.2016.11.002 ↗
65. Differential evolution algorithm-based range image registration for free-form surface parts quality inspection10.1016/j.swevo.2017.04.006 ↗
66. JADE: Adaptive differential evolution with optional external archive
67. Coral Reef Optimization with substrate layers for medical Image Registration10.1016/j.swevo.2018.03.003 ↗
68. New coral reefs-based approaches for the model type selection problem: A novel method to predict a Nation’s future energy demand10.1504/IJBIC.2017.086698 ↗
69. Cocianu, C., and Stan, A. (2019). New Evolutionary-Based Techniques for Image Registration. Appl. Sci., 9.10.3390/app9010176 ↗
70. Yang, X. (2014). Nature-Inspired Optimization Algorithms, Elsevier Inc.10.1016/B978-0-12-416743-8.00010-5 ↗
71. Bilgic, T., Baets, B.D., and Bogazici, O. (2003). A CHC evolutionary algorithm for 3D image registration. International Fuzzy Systems Association World Congress (IFSA’03), Springer. Lect. Notes Artif. Int. 2715.
72. An approach to multimodal biomedical image registration utilizing particle swarm optimization10.1109/TEVC.2004.826068 ↗
73. Rundo, L., TangherLoni, A., Militello, C., Gilardi, M., and Mauri, G. (2016, January 6–9). Multimodal Medical Image Registration Using Particle Swarm Optimization: A Review. Proceedings of 2016 IEEE Symposium Series on Computational Intelligence (SSCI), Athens, Greece.10.1109/SSCI.2016.7850261 ↗
74. A deep learning framework for unsupervised affine and deformable image registration10.1016/j.media.2018.11.010 ↗
75. VoxelMorph: A Learning Framework for Deformable Medical Image Registration10.1109/TMI.2019.2897538 ↗