Computer-Aided Facial Soft Tissue Reconstruction with Computer Vision: A Modern Approach to Identifying Unknown Individuals
Source abstract
Abstract
Facial soft tissue reconstruction is an important tool in forensic investigations, especially when conventional identification methods are unsuccessful. This paper presents a digital workflow for facial reconstruction and identity verification using computer vision techniques applied to two forensic cases. The first case involves a cold case from 1993, in which a manual reconstruction by Prof. Helmer was conducted in 1994. We digitally reconstructed the same individual using CAD software (Blender), enabling a direct comparison between manual and digital techniques. To date, the deceased remains unidentified. The second case, from 2021, involved a digitally reconstructed face that was later matched to a missing person through DNA analysis. Here, comparison material was available, including an official photograph. A police officer involved in the case noted a “striking resemblance” between the reconstruction and the photograph. To evaluate this subjective impression, we performed quantitative analyses using three face recognition models (Dlib-based method, VGG-Face, and GhostFaceNet). The models did not indicate significant similarity, highlighting a gap between human perception and algorithmic assessment. These findings suggest that current face recognition algorithms may not yet be fully suited to evaluating reconstructions, which tend to deviate in subtle but critical facial features. To achieve better facial recognition results, further research is required to generate more anatomically accurate and detailed reconstructions that align more closely with the sensitivity of AI-based identification systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Face recognition and analysis · Facial Nerve Paralysis Treatment and Research · Biometric Identification and Security
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Applied Computer Sciences and Biosciences, University of Applied Sciences Mittweida, 09649 Mittweida, Germany
Faculty of Medicine, Institute of Legal Medicine, 80539 Munich, Germany
References (90)
Show source-provided references
1. Application of 3-D computer graphics for facial reconstruction and comparison with sculpting techniques10.1016/0379-0738(89)90200-4 ↗
2. Facial reconstruction–anatomical art or artistic anatomy?10.1111/j.1469-7580.2009.01182.x ↗
3. Methods of forensic facial reconstruction and human identification: Historical background, significance, and limitations10.1007/s00114-023-01838-9 ↗
4. Forensische Anthropologie und Osteologie–Übersicht und Definitionen
5. Forensische Anthropologie im 21. Jahrhundert10.1007/s00194-013-0873-x ↗
6. Gottschaldt, U. (2003). Anthropologische Untersuchungen zur Geschlechtsbestimmung Adulter Individuen Sowie zur Altersschätzung Subadulter Individuen. [Ph.D. Thesis, Friedrich-Schiller-Universität].
7. Uerlings, H. (1991). Zur Geschlechtsbestimmung von Menschlichen Skelettteilen. [Ph.D. Thesis, Friedrich-Schiller-Universität].
8. Redesign of missing mandible by determining age group and gender from morphometric features of skull for facial reconstruction (approximation)10.1007/s12520-021-01315-2 ↗
9. Sex determination of the skeleton by guess and by measurement10.1002/ajpa.1330120312 ↗
10. Sex determination by discriminant function analysis of crania10.1002/ajpa.1330210108 ↗
11. On Gerasimov’s Plastic Facial Reconstruction Technique: New Insights to Facilitate Repeatability10.1111/j.1556-4029.2010.01672.x ↗
12. History of facial reconstruction
13. Large-scale in-vivo Caucasian facial soft tissue thickness database for craniofacial reconstruction10.1016/j.forsciint.2006.02.034 ↗
14. Neave, R., and Prag, J. (1997). Making faces. Using Forensic and Archaeological Evidence, British Museum Press.
15. Facial approximation—From facial reconstruction synonym to face prediction paradigm10.1111/1556-4029.12732 ↗
16. Wilkinson, C. (2004). Forensic Facial Reconstruction, Cambridge University Press.10.1017/CBO9781107340961 ↗
17. The reconstruction of a face showing a healed wound10.1016/S0305-4403(03)00019-0 ↗
18. 3D Face Reconstruction: The Road to Forensics
19. Facial reconstruction using 3-D computerized method: A scoping review of Methods, current Status, and future developments10.1016/j.legalmed.2023.102239 ↗
20. 3D facial reconstruction and 3D printing of women skull from Bronze age, Slovakia
21. La Cava, S.M., Orrù, G., Goldmann, T., Drahansky, M., and Marcialis, G.L. (2022, January 21–25). 3D face reconstruction for forensic recognition-a survey. Proceedings of the 2022 26th International Conference on Pattern Recognition (ICPR), Montreal, QC, Canada.10.1109/ICPR56361.2022.9956031 ↗
22. CT scans-a compelling tool in forensic facial reconstruction
23. Damas, S., Cordón, O., and Ibáñez, O. (2020). Handbook on Craniofacial Superimposition: The Meprocs Project, Springer Nature.10.1007/978-3-319-11137-7 ↗
24. Demonstration of protocol for computer-aided forensic facial reconstruction with free software and photogrammetry10.19177/jrd.v2e1201477-90 ↗
25. A computerized facial approximation method for Homo sapiens based on facial soft tissue thickness depths and geometric morphometrics10.1111/joa.13920 ↗
26. Anthropological Facial Approximation in Three Dimensions (AFA 3D): Computer-Assisted Estimation of the Facial Morphology Using Geometric Morphometrics10.1111/1556-4029.12547 ↗
27. 3D forensic facial approximation: Implementation protocol in a forensic activity10.1111/1556-4029.14587 ↗
28. Forensic facial reconstruction using CBCT: A systematic review
29. Facial reconstruction of mummified remains of Christian Saint-Nicolosa Bursa10.1016/j.culher.2019.08.008 ↗
30. Miranda, G.E., Wilkinson, C., Roughley, M., Beaini, T.L., and Melani, R.F.H. (2018). Assessment of accuracy and recognition of three-dimensional computerized forensic craniofacial reconstruction. PLoS ONE, 13.10.1371/journal.pone.0196770 ↗
31. Forensic Facial Reconstruction Using 3D Printing10.37358/MP.20.4.5424 ↗
32. Photogrammetry vs CT Scan: Evaluation of Accuracy of a Low-Cost Three-Dimensional Acquisition Method for Forensic Facial Approximation10.1111/1556-4029.14319 ↗
33. Lussu, P., and Marini, E. (2020). Ultra close-range digital photogrammetry in skeletal anthropology: A systematic review. PLoS ONE, 15.10.1371/journal.pone.0230948 ↗
34. Virtual anthropology? Reliability of three-dimensional photogrammetry as a forensic anthropology measurement and documentation technique10.1007/s00414-020-02473-z ↗
35. Photogrammetric 3D skull/photo superimposition: A pilot study10.1016/j.forsciint.2017.02.006 ↗
36. (2021, August 10). Agisoft Metashape. Version 1.8.1. Available online: https://www.agisoft.com/.
37. Bebis, G., Boyle, R., Parvin, B., Koracin, D., Pavlidis, I., Feris, R., McGraw, T., Elendt, M., Kopper, R., and Ragan, E. (2015). InVesalius: An Interactive Rendering Framework for Health Care Support. Advances in Visual Computing, Springer. Version 3.1.10.1007/978-3-319-27863-6 ↗
38. (2021, August 10). Meshroom. Version 2021.1.0. Available online: https://alicevision.org/.
39. Luhmann, T., and Schumacher, C. (2020). One Head, many Approaches–Comparing 3D Models of a Fossil Skull. Photogrammetrie–Laserscanning–Optische 3D-Messtechnik: Beiträge der Oldenburger 3D-Tage, Wichmann.
40. Study of the facial morphology of young bulgarians with 3D laser scan10.15547/tjs.2019.s.02.023 ↗
41. Drewello, R. (2018). 4. 3D-Modellierung von Skulpturen mit Laserscan und die quantitative Erfassung der 3D-Flächenmaße von Verwitterungsphänomenen. Risk Number. Determining and Objectively Assessing Environmental Damage on Marble and Sandstone Sculptures, University of Bamberg Press.
42. Toneva, D., Nikolova, S., Georgiev, I., and Tchorbadjieff, A. (2017). Accuracy of linear craniometric measurements obtained from laser scanning created 3D models of dry skulls. Advanced Computing in Industrial Mathematics, Springer.10.1007/978-3-319-49544-6_18 ↗
43. (2021, August 10). Blender. Used for Reconstruction (v2.7, 2021) and Rendering (v3.4, 2024). Available online: https://www.blender.org/.
44. New technique in facial reconstruction: The case of Giovanni Battista Morgagni10.1127/anthranz/2018/0818 ↗
45. Prediction of nasal morphology from the skull10.1007/s12024-009-9124-6 ↗
46. Predicting nose projection and pronasale position in facial approximation: A test of published methods and proposal of new guidelines10.1002/ajpa.10300 ↗
47. Mouth width prediction in craniofacial identification: Cadaver tests of four recent methods, including two techniques for edentulous skulls
48. Kim, Y.S., Lee, W.J., Yun, J.S., Kim, D.H., Lozanoff, S., and Lee, U.Y. (2023). Predicting the eyebrow from the orbit using three-dimensional CT imaging in the application of forensic facial reconstruction and identification. Sci. Rep., 13.10.1038/s41598-023-30758-x ↗
49. Forensic facial reconstruction: An anthropometric study of the ear10.1080/00450618.2024.2306679 ↗
50. Regression analysis of nasal shape from juvenile to adult ages for forensic facial reconstruction10.1016/j.legalmed.2023.102363 ↗
51. Gesichtsweichteilrekonstruktion mithilfe einer Open-Source-Software10.1007/s00194-015-0067-9 ↗
52. Forensic Facial Reconstruction: The Final Frontier
53. Becker, S., Rosenfelder, J., and Labudde, D. (2023). Forensische Gesichtsweichteilrekonstruktion einer historischen Person: So sahen unsere Vorfahren aus!. NextGen Sci. Rev., 36–46.
54. Burrath, S. (2009). Visuelle Personenidentifizierung und Polizeiliche Personenbeschreibung: Praxishandbuch, Verlag für Polizeiwissenschaft.
55. (2021, August 17). FaceDB. Available online: https://www.face-rec.org/databases/.
56. Krogman, W., and Iscan, N. (1986). Radiographic analysis. The Human Skeleton in Forensic Medicine, Charles C Thomas.
57. Sassouni, V. (1957). Palatoprint, Physioprint, and Roentgenographic Cephalometry, as New Methods in Human Identification: Preliminary Report, Callaghan.
58. Verhoff, M.A. (2008). Forensische Osteologie: Problematische Fragestellungen, Lehmanns Media.
59. A Comprehensive Framework for High Resolution Image-based 3D Modeling and Documentation of Crime Scenes and Disaster Sites
60. (2021, August 10). Stageonair. Available online: https://www.stageonair.com/.
61. Kollmann, J., and Büchly, W. (1898). Die Persistenz der Rassen und die Reconstruction der Physiognomie Prähistorischer Schädel, Archiv f. Anthrop.
62. Variation in soft-tissue thicknesses on the human face and their relation to craniometric dimensions10.1002/ajpa.10073 ↗
63. Werner, G. (2009). Weichteilverschiebung im Gesicht bei Personen in Stehender und Liegender Position. [Ph.D. Thesis, Universität Leipzig].
64. Rhine, J.S., Moore, C.E., and Weston, J. (1982). Facial Reproduction: Tables of Facial Tissue Thicknesses of American Caucasoids in Forensic Anthropology, Maxwell Museum of Anthroplogy, The University of New Mexico.
65. Ancestry and BMI influences on facial soft tissue depths for a cohort of Chinese and Caucasoid women in Dunedin, New Zealand10.1111/1556-4029.12799 ↗
66. Position effect on facial soft tissue depths: A sonographic investigation10.1111/1556-4029.12935 ↗
67. Taylor, K.T. (2000). Forensic Art and Illustration, CRC Press.10.1201/9781420036954 ↗
68. Predicting mouth width from inter-canine width-a 75% rule10.1520/JFS2002418 ↗
69. Kersten, T.P., Tschirschwitz, F., Deggim, S., and Lindstaedt, M. (November, January 29). Virtual reality for cultural heritage monuments–from 3d data recording to immersive visualisation. Proceedings of the Euro-Mediterranean Conference, Nicosia, Cyprus.
70. From photo to 3D to mixed reality: A complete workflow for cultural heritage visualisation and experience
71. An appraisal of plastic reconstruction of the external nose10.1520/JFS11917J ↗
72. How effective are landmarks and their geometry for face recognition?10.1016/j.cviu.2005.10.002 ↗
73. Nagamalla, S., and Dhara, B.C. (2009, January 4–6). A novel face recognition method using facial landmarks. Proceedings of the 2009 Seventh International Conference on Advances in Pattern Recognition, Kolkata, India.10.1109/ICAPR.2009.59 ↗
74. Kim, I., Han, S., Park, S.J., Baek, J.W., Shin, J., Han, J.J., and Choi, C. (December, January 30). Discface: Minimum discrepancy learning for deep face recognition. Proceedings of the Asian Conference on Computer Vision, Kyoto, Japan.
75. Zhang, D., Li, J., and Shan, Z. (2020, January 7–8). Implementation of Dlib deep learning face recognition technology. Proceedings of the 2020 International Conference on Robots & Intelligent System (ICRIS), Sanya, China.10.1109/ICRIS52159.2020.00030 ↗
76. Face recognition documentation
77. Parkhi, O.M., Vedaldi, A., and Zisserman, A. (2015, January 7–10). Deep Face Recognition. Proceedings of the British Machine Vision Conference, Swansea, UK.
78. GhostFaceNets: Lightweight Face Recognition Model From Cheap Operations10.1109/ACCESS.2023.3266068 ↗
79. Jocher, G., Qiu, J., and Chaurasia, A. (2025, May 07). Ultralytics YOLO, 2023. Version 8.0.0. Available online: https://github.com/ultralytics/ultralytics.
80. King, D.E. (2025, May 07). CNN Face Detection Using Dlib (Version 19.3.0). Available online: https://dlib.net/cnn_face_detector.py.html.
81. MTCNN++: A CNN-based face detection algorithm inspired by MTCNN10.1007/s00371-023-02822-0 ↗
82. Honekamp, W., and Fähndrich, J. (2023). Einsatz von Algorithmen zur Gesichtserkennung in Kipo Verfahren—Vorstellung Einer Pipeline zur Automatisierten Verarbeitung; Polizei-Informatik 2023, Rediroma Verlag.
83. O’shea, K., and Nash, R. (2015). An introduction to convolutional neural networks. arXiv.
84. King, D.E. (2025, May 07). Face Recognition Using Dlib (Version 19.3.0). Available online: https://dlib.net/face_recognition.py.html.
85. Koestinger, M., Wohlhart, P., Roth, P.M., and Bischof, H. (2011, January 6–13). Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. Proceedings of the 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain.10.1109/ICCVW.2011.6130513 ↗
86. Huang, G.B., Mattar, M., Berg, T., and Learned-Miller, E. (2008, January 17). Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments. Proceedings of the Workshop on Faces in ‘Real-Life’ Images: Detection, Alignment, and Recognition, Erik Learned-Miller and Andras Ferencz and Frédéric Jurie, Marseille, France.
87. A Benchmark of Facial Recognition Pipelines and Co-Usability Performances of Modules
88. Presse-Agentur, D. (2025, May 06). Freden: Erneuter DNA-Abgleich: Unbekannter Toter Ist Identifiziert. Available online: https://www.zeit.de/news/2022-03/23/erneuter-dna-abgleich-unbekannter-toter-ist-identifiziert.
89. Matching Software-Generated Sketches to Face Photographs with a Very Deep CNN, Morphed Faces, and Transfer Learning10.1109/TIFS.2017.2788002 ↗
90. Preuß, S., and Labudde, D. (2024). Digitale Fortschritte in der Gesichtsweichteilrekonstruktion: Von manuellen Methoden zu Künstlicher Intelligenz. 24. Nachwuchswissenschaftler: Innenkonferenz, Hochschule Mittweida.