journal article·2020-07-08Open access

A Survey on Artificial Intelligence Techniques for Biomedical Image Analysis in Skeleton-Based Forensic Human Identification

Pablo Mesejo, Rubén Martos, Óscar Ibáñez, Jorge Novo, Marcos Ortega

Applied Sciences· Volume 10· Issue 14

Abstract

This paper represents the first survey on the application of AI techniques for the analysis of biomedical images with forensic human identification purposes. Human identification is of great relevance in today’s society and, in particular, in medico-legal contexts. As consequence, all technological advances that are introduced in this field can contribute to the increasing necessity for accurate and robust tools that allow for establishing and verifying human identity. We first describe the importance and applicability of forensic anthropology in many identification scenarios. Later, we present the main trends related to the application of computer vision, machine learning and soft computing techniques to the estimation of the biological profile, the identification through comparative radiography and craniofacial superimposition, traumatism and pathology analysis, as well as facial reconstruction. The potentialities and limitations of the employed approaches are described, and we conclude with a discussion about methodological issues and future research.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Forensic Anthropology and Bioarchaeology Studies · Autopsy Techniques and Outcomes · Dental Radiography and Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science and Artificial Intelligence, University of Granada, 18071 Granada, Spain

Andalusian Research Institute DaSCI, University of Granada, 18071 Granada, Spain

Panacea Cooperative Research S. Coop., 24401 Ponferrada, Spain

Department of Legal Medicine, Toxicology and Physical Anthropology, University of Granada, 18071 Granada, Spain

Department of Computer Science and Information Technology, University of Coruña, 15011 A Coruña, Spain

Centro de investigación CITIC, Universidade da Coruña, 15071 A Coruña, Spain

Funding

European Regional Development Fund · Spanish Ministry of Science, Innovation and Universities · Junta de Andalucía · Spanish Ministry of Science, Innovation and Universities-CDTI · H2020 Marie Skłodowska-Curie Actions

References (100+)

Show source-provided references
1. Thompson, T., and Black, S. (2006). Forensic Human Identification: An Introduction, CRC Press.10.1201/9781420005714 ↗
2. Thibault, E.A., Lynch, L.M., McBride, R.B., and Walsh, G. (2004). Proactive Police Management, Prentice Hall.
3. Ubelaker, D.H. (2008). Forensic anthropology: Methodology and diversity of applications. Biological Anthropology of the Human Skeleton, John Wiley & Sons, Inc.10.1002/9780470245842.ch2 ↗
4. Beauthier, J.P., Valck, E., Lefevre, P., and Winne, J.D. (2009). Mass disaster victim identification: The tsunami experience. Open Forensic Sci. J., 2.10.2174/1874402800902010054 ↗
5. Forensic identification by computer-aided craniofacial superimposition: A survey10.1145/1978802.1978806 ↗
6. Nissan, E. (2012). Computer Applications for Handling Legal Evidence, Police Investigation and Case Argumentation, Springer.10.1007/978-90-481-8990-8 ↗
7. Jain, A.K., and Li, S.Z. (2011). Handbook of Face Recognition, Springer.
8. Valentine, T., and Davis, J.P. (2015). Forensic facial identification: A practical guide to best practice. Forensic Facial Identification: Theory and Practice of Identification from Eyewitnesses, Composites and CCTV, John Wiley & Sons.10.1002/9781118469538 ↗
9. An overview of the latest developments in facial imaging10.1080/20961790.2018.1519892 ↗
10. Face recognition: A literature survey10.1145/954339.954342 ↗
11. A comprehensive survey on pose-invariant face recognition10.1145/2845089 ↗
12. England, N., and Improvement, N. (2016). Diagnostic Imaging Dataset Statistical Release.
13. Laserson, J., Lantsman, C.D., Cohen-Sfady, M., Tamir, I., Goz, E., Brestel, C., Bar, S., Atar, M., and Elnekave, E. (2018, January 16–20). Textray: Mining clinical reports to gain a broad understanding of chest x-rays. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Granada, Spain.10.1007/978-3-030-00934-2_62 ↗
14. Post-mortem forensic neuroimaging: Correlation of MSCT and MRI findings with autopsy results10.1016/j.forsciint.2007.01.027 ↗
15. Evaluation of injuries of the upper cervical spine in a postmortem study with digital radiography, CT and MRI
16. Recomendations for age and sex diagnosis of skeletons10.1016/0047-2484(80)90061-5 ↗
17. Aguilera, I.A. (1997). Determinación del Sexo en el Esqueleto Postcraneal. Estudio de una Población Mediterránea Actual. [Ph.D. Thesis, Universidad de Granada].
18. Validation of the sex estimation method elaborated by Schutkowski in the Granada Osteological Collection of identified infant and young children: Analysis of the controversy between the different ways of analyzing and interpreting the results10.1007/s00414-016-1354-z ↗
19. Skeletal age determination based on the os pubis: A comparison of the Acsádi-Nemeskéri and Suchey-Brooks methods10.1007/BF02437238 ↗
20. A simple technique for age estimation in adult corpses: The two criteria dental method10.1520/JFS13327J ↗
21. The two step strategy (TSS) or the right way to combine a dental (Lamendin) and an anthropological (Suchey–Brooks system) method for age determination
22. Chronological metamorphosis of the auricular surface of the ilium: A new method for the determination of adult skeletal age at death10.1002/ajpa.1330680103 ↗
23. Age estimation from the rib by phase analysis: White males10.1520/JFS11776J ↗
24. Ectocranial suture closure: A revised method for the determination of skeletal age at death based on the lateral-anterior sutures10.1002/ajpa.1330680106 ↗
25. Scheuer, L., and Black, S. (2004). The Juvenile Skeleton, Elsevier.10.1016/B978-012102821-3/50001-8 ↗
26. Greulich, W.W., and Pyle, S.I. (1959). Radiographic Atlas of Skeletal Development of the Hand and Wrist, Stanford University Press.10.1097/00000441-195909000-00030 ↗
27. A new system of dental age assessment
28. Forensic age estimation in living subjects based on the ossification status of the medial clavicular epiphysis as revealed by thin-slice multidetector computed tomography10.1007/s00414-009-0398-8 ↗
29. Nunes de Mendonça, M. (1998). Contribución para la identificación humana a partir del estudio de las estructuras óseas. Determinacion de la Talla a Traves de la Longitud de los Huesos Largos, Universidad Complutense de Madrid.
30. Belmonte, M. (2012). Determinación de la Estatura a Través de la Tibia en Población Española Contemporánea. [Ph.D. Thesis, Universidad de Granada].10.4321/S1135-76062011000200005 ↗
31. A re-evaluation of estimation of stature based on measurements of stature taken during life and of long bones after death10.1002/ajpa.1330160106 ↗
32. Ousley, S.D., and Jantz, R.L. (1996). FORDISC 2.0: Personal Computer Forensic Discriminant Functions, University of Tennessee.
33. Morphometric comparison of clavicle outlines from 3D bone scans and 2D chest radiographs: A shortlisting tool to assist radiographic identification of human skeletons10.1111/1556-4029.12324 ↗
34. The Use of X-ray Computed Tomography Technologies in Forensic Anthropology10.5744/fa.2018.0013 ↗
35. RADid: A pictorial review of radiologic identification using postmortem CT10.1016/j.jofri.2014.02.039 ↗
36. Optical 3D surface digitizing in forensic medicine: 3D documentation of skin and bone injuries10.1016/j.forsciint.2003.07.009 ↗
37. Radiographic identification using midline medical sternotomy wires10.1111/1556-4029.12610 ↗
38. Iscan, M.Y., and Helmer, R. (1993). Forensic Analysis of the Skull, Willey-Liss.
39. Craniofacial identification: Techniques of facial approximation and craniofacial superimposition
40. Study on the performance of different craniofacial superimposition approaches (II): Best practices proposal10.1016/j.forsciint.2015.07.045 ↗
41. Past, present, and future of CFS: Literature and international surveys10.1016/j.legalmed.2015.02.001 ↗
42. Damas, S., Cordón, O., and Ibáñez, O. (2020). Handbook on Craniofacial Superimposition: The MEPROCS Project, Springer Nature.10.1007/978-3-319-11137-7 ↗
43. Building faces from dry skulls: Are they recognized above chance rates?10.1520/JFS14993J ↗
44. Taylor, R., and Craig, P. (2005). The wisdom of bones: Facial approximation on the skull. Computer Graphic Facial Reconstruction, Academic Press.
45. Wilkinson, C. (2004). Forensic Facial Reconstruction, Cambridge University Press.10.1017/CBO9781107340961 ↗
46. Wilkinson, C., and Rynn, C. (2012). Craniofacial Identification, Cambridge University Press.10.1017/CBO9781139049566 ↗
47. An accuracy assessment of forensic computerized facial reconstruction employing cone-beam computed tomography from live subjects10.1111/j.1556-4029.2011.01971.x ↗
48. Computerized craniofacial reconstruction: Conceptual framework and review10.1016/j.forsciint.2010.03.008 ↗
49. Preliminary performance assessment of computer automated facial approximations using computed tomography scans of living individuals10.1016/j.forsciint.2013.08.031 ↗
50. Anthropological Facial Approximation in Three Dimensions (AFA3D): Computer-Assisted Estimation of the Facial Morphology Using Geometric Morphometrics10.1111/1556-4029.12547 ↗
51. A facial reconstruction method based on new mesh deformation techniques10.1080/20961790.2018.1469185 ↗
52. Foster, K.R., and Huber, P.W. (1999). Judging Science: Scientific Knowledge and the Federal Courts, MIT Press.
53. Forsyth, D.A., and Ponce, J. (2002). Computer Vision: A Modern Approach, Prentice Hall Professional Technical Reference.
54. Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer.
55. Deep learning10.1038/nature14539 ↗
56. Engelbrecht, A.P. (2007). Computational Intelligence: An Introduction, John Wiley & Sons.10.1002/9780470512517 ↗
57. Zadeh, L.A. (1996). Soft computing and fuzzy logic. Fuzzy Sets, Fuzzy Logic, and Fuzzy Systems: Selected Papers by Lotfi a Zadeh, World Scientific.10.1142/9789814261302_0042 ↗
58. Eiben, A.E., and Smith, J.E. (2003). Introduction to Evolutionary Computing, Springer.10.1007/978-3-662-05094-1 ↗
59. A computational TW3 classifier for skeletal maturity assessment. A computing with words approach10.1016/j.jbi.2004.01.002 ↗
60. Fully automatic bone age estimation from left hand MR images
61. Automated bone age assessment: Motivation, taxonomies, and challenges10.1155/2013/391626 ↗
62. Two-Dimensional Wavelet Analysis of Supraorbital Margins of the Human Skull for Characterizing Sexual Dimorphism10.1109/TIFS.2016.2541611 ↗
63. Abdullah, H., Jamil, M.M.A., and Nor, F.M. (2017, January 24–25). Automated Haversian Canal Detection for Histological Sex Determination. Proceedings of the IEEE Symposium on Computer Applications & Industrial Electronics (ISCAIE), Langkawi, Malaysia.10.1109/ISCAIE.2017.8074952 ↗
64. Computer-assisted bone age assessment: Image preprocessing and epiphyseal/metaphyseal ROI extraction10.1109/42.938240 ↗
65. Computer-assisted bone age assessment—Database adjustment10.1016/S0531-5131(03)00295-4 ↗
66. Computer-assisted bone age assessment: Graphical user interface for image processing and comparison10.1007/s10278-004-1006-6 ↗
67. 11K Hands: Gender recognition and biometric identification using a large dataset of hand images10.1007/s11042-019-7424-8 ↗
68. A comparison between neural network and other metric methods to determine sex from the upper femur in a modern French population
69. Sex estimation from the tarsal bones in a Portuguese sample: A machine learning approach10.1007/s00414-014-1070-5 ↗
70. Buikstra, J.E. (1994). Standards for data collection from human skeletal remains. Ark. Archaeol. Surv. Res. Ser., 44.
71. A review of sex estimation techniques during examination of skeletal remains in forensic anthropology casework10.1016/j.forsciint.2016.02.007 ↗
72. The Difficulty of Sexing Skeletons from Unknown Populations10.1155/2015/908535 ↗
73. Darmawan, M.F., Yusuf, S.M., Rozi, M.A., and Haron, H. (2015, January 13–14). Hybrid PSOANN for sex estimation based on length of left hand bone. Proceedings of the 2015 IEEE Student Conference on Research and Development (SCOReD), Kuala Lumpur, Malaysia.10.1109/SCORED.2015.7449382 ↗
74. Artificial intelligence for sex determination of skeletal remains: Application of a deep learning artificial neural network to human skulls10.1016/j.jflm.2019.01.004 ↗
75. Kaloi, M.A., and He, K. (2018). Child Gender Determination with Convolutional Neural Networks on Hand Radio-Graphs. arXiv.
76. Patella sex determination by 3D statistical shape models and nonlinear classifiers10.1016/j.forsciint.2007.02.024 ↗
77. Sex determination of three-dimensional skull based on improved backpropagation neural network10.1155/2019/9163547 ↗
78. Arigbabu, O.A., Liao, I.Y., Abdullah, N., and Noor, M.H.M. (2016, January 20–24). Can computer vision techniques be applied to automated forensic examinations? A study on sex identification from human skulls using head CT scans. Proceedings of the Asian Conference on Computer Vision, Taipei, Taiwan.10.1007/978-3-319-54190-7_21 ↗
79. Tanner, J.M., Whitehouse, R., Cameron, N., Marshall, W., Healy, M., and Goldstein, H. (2001). Assessment of Skeletal Maturity and Prediction of Adult Height (TW2 Method), Saunders.
80. Prieto, J., Mihaila, S., Hilaire, A., Fanton, L., Odet, C., and Revol-Muller, C. (2012, January 16–19). Age estimation from 3D X-ray CT images of human fourth ribs. Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV), Las Vegas, NV, USA.
81. Bone age assessment practices in infants and older children among Society for Pediatric Radiology members10.1007/s00247-016-3618-7 ↗
82. Assessment of skeletal maturity and prediction of adult height (TW3 method)10.1002/ajhb.10098 ↗
83. Skeletal age estimation for forensic purposes: A comparison of GP, TW2 and TW3 methods on an Italian sample10.1016/j.forsciint.2014.02.030 ↗
84. Computerized Bone Age Estimation Using Deep Learning Based Program: Evaluation of the Accuracy and Efficiency10.2214/AJR.17.18224 ↗
85. Performance of a deep-learning neural network model in assessing skeletal maturity on pediatric hand radiographs10.1148/radiol.2017170236 ↗
86. Fully automated deep learning system for bone age assessment10.1007/s10278-017-9955-8 ↗
87. Applying Deep Learning in Medical Images: The Case of Bone Age Estimation10.4258/hir.2018.24.1.86 ↗
88. MABAL: A Novel Deep-Learning Architecture for Machine-Assisted Bone Age Labeling10.1007/s10278-018-0053-3 ↗
89. Computerized geometric features of carpal bone for bone age estimation10.1097/00029330-200705010-00006 ↗
90. A fuzzy inference system for skeletal age assessment in living individual10.1007/s40815-016-0232-7 ↗
91. Deep learning for automated skeletal bone age assessment in X-ray images10.1016/j.media.2016.10.010 ↗
92. Automatic analysis of hand radiographs for the assessment of skeletal age: A subsymbolic approach10.1006/cbmr.1995.1016 ↗
93. Pediatric skeletal age: Determination with neural networks10.1148/radiology.195.3.7753995 ↗
94. Skeletal growth estimation using radiographic image processing and analysis10.1109/4233.897061 ↗
95. Bone age assessment of children using a digital hand atlas10.1016/j.compmedimag.2007.02.012 ↗
96. Segmentation of regions of interest and post-segmentation edge location improvement in computer-aided bone age assessment10.1007/s10044-006-0056-4 ↗
97. Bone age estimation based on phalanx information with fuzzy constrain of carpals10.1007/s11517-006-0155-9 ↗
98. Automatic bone age assessment for young children from newborn to 7-year-old using carpal bones10.1016/j.compmedimag.2007.02.008 ↗
99. Automatic bone age assessment based on intelligent algorithms and comparison with TW3 method10.1016/j.compmedimag.2008.08.005 ↗
100. A radius and ulna TW3 bone age assessment system10.1109/TBME.2008.918554 ↗