journal article·2025-05-02Open access

A Convolutional Neural Network as a Potential Tool for Camouflage Assessment

Erik Van der Burg, Alexander Toet, Paola Perone, Maarten A. Hogervorst

Applied Sciences· Volume 15· Issue 9

Abstract

Camouflage evaluation is traditionally evaluated through human visual search and detection experiments, which are time-consuming and resource intensive. To address this, we explored whether a pre-trained convolutional neural network (YOLOv4-tiny) can provide an automated, image-based measure of camouflage effectiveness that aligns with human perception. We conducted behavioral experiments to obtain human detection performance metrics—such as search time and target conspicuity—and compared these to the classification probabilities output by the YOLO model when detecting camouflaged individuals in rural and urban scenes. YOLO’s classification probability was adopted as a proxy for detectability, allowing direct comparison with human observer performance. We found a strong overall correspondence between YOLO-predicted camouflage effectiveness and human detection results. However, discrepancies emerged at close distances, where YOLO’s performance was particularly sensitive to high-contrast, shape-breaking elements of the camouflage pattern. CNNs such as YOLO have significant potential for assessing camouflage effectiveness for a wide range of applications, such as evaluating or optimizing one’s signature and predicting optimal hiding locations in each environment. Still, further research is required to fully establish YOLO’s limitations and applicability for this purpose in real time.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Visual Attention and Saliency Detection · Olfactory and Sensory Function Studies · Visual perception and processing mechanisms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Section Clinical Developmental Psychology, Vrije Universiteit Amsterdam, 1081BT Amsterdam, The Netherlands

TNO, Human Factors, 3769DE Soesterberg, The Netherlands

References (80)

Show source-provided references
1. Computational versus psychophysical image saliency: A comparative evaluation study10.1109/TPAMI.2011.53 ↗
2. Toet, A., and Hogervorst, M. (2020, January 20). Review of camouflage assessment techniques. Proceedings of the Target and Background Signatures VI, Orlando, FL, USA.10.1117/12.2566183 ↗
3. Camouflage design, assessment and breaking techniques: A survey10.1007/s00530-021-00813-6 ↗
4. Research status and development trend of image camouflage effect evaluation10.1007/s11042-022-12287-3 ↗
5. Assessment method for camouflage performance based on visual perception10.1016/j.optlaseng.2022.107152 ↗
6. Ramsey, S., Mayo, T., Howells, C., Shabaev, A., and Lambrakos, S.G. (2018, January 8). Modeling apparent camouflage patterns for visual evaluation. Proceedings of the Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XXIV, Orlando, FL, USA.
7. Ramsey, S., Mayo, T., Shabaev, A., and Lambrakos, S. (2017, January 7–8). Modeling apparent color for visual evaluation of camouflage fabrics. Proceedings of the Optics and Photonics for Information Processing XI, San Diego, CA, USA.
8. Finding flicker: Critical differences in temporal frequency capture attention10.3389/fpsyg.2011.00320 ↗
9. Van der Burg, E., Cass, J., Olivers, C.N.L., Theeuwes, J., and Alais, D. (2010). Efficient visual search from synchronized auditory signals requires transient audiovisual events. PLoS ONE, 5.10.1371/journal.pone.0010664 ↗
10. Changes (but not differences) in motion direction fail to capture attention10.1016/j.visres.2019.09.008 ↗
11. Driggers, R.G. (2003). Visual conspicuity. Encyclopedia of Optical Engineering, Marcel Dekker Inc.
12. Visual conspicuity determines human target acquisition performance10.1117/1.601903 ↗
13. van der Burg, E., Ju, J., Hogervorst, M.A., Lee, B., Culpepper, J., and Toet, A. (2021, January 12). The relation between visual search and visual conspicuity for moving targets. Proceedings of the Target and Background Signatures VII, Online.10.1117/12.2600307 ↗
14. Beintema, J.A., and Toet, A. (2011, January 26–28). Conspicuity of moving soldiers. Proceedings of the Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXII, Orlando, FL, USA.10.1117/12.884241 ↗
15. Toet, A. (2001). Visual conspicuity of targets in synthetic IR imagery. Camouflage, Concealment and Deception Evaluation Techniques, North Atlantic Treaty Organization.
16. Toet, A., Kooi, F.L., Kuijper, F., and Smeenk, R.J.M. (April, January 28). Objective assessment of simulated daytime and NVG image fidelity. Proceedings of the Enhanced and Synthetic Vision 2005, Orlando, FL, USA.10.1117/12.602463 ↗
17. Bai, X., Liao, N., and Wu, W. (2020). Assessment of camouflage effectiveness based on perceived color difference and gradient magnitude. Sensors, 20.10.3390/s20174672 ↗
18. MF-CFI: A fused evaluation index for camouflage patterns based on human visual perception10.1016/j.dt.2020.08.007 ↗
19. Deep Neural Networks: A new framework for modeling biological vision and brain information processing10.1146/annurev-vision-082114-035447 ↗
20. den Hollander, R., Adhikari, A., Tolios, I., van Bekkum, M., Bal, A., Hendriks, S., Kruithof, M., Gross, D., Jansen, N., and Perez, G. (2020, January 21–25). Adversarial patch camouflage against aerial detection. Proceedings of the Artificial Intelligence and Machine Learning in Defense Applications II, Orlando, FL, USA.10.1117/12.2575907 ↗
21. Unmasking Clever Hans predictors and assessing what machines really learn10.1038/s41467-019-08987-4 ↗
22. CamoGAN: Evolving optimum camouflage with Generative Adversarial Networks10.1111/2041-210X.13334 ↗
23. The Camouflage Machine: Optimizing protective coloration using deep learning with genetic algorithms10.1111/evo.14162 ↗
24. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
25. Van der Burg, E., Hogervorst, M.A., and Toet, A. (2022, January 5). Measuring the dynamics of camouflage in natural scenes using convolutional neural networks. Proceedings of the Target and Background Signatures VIII, Berlin, Germany.10.1117/12.2636107 ↗
26. Hall, J.R., Cuthill, I.C., Baddeley, R.B., Shohet, A.J., and Scott-Samuel, N.E. (2013). Camouflage, detection and identification of moving targets. Proc. R. Soc. B Biol. Sci., 280.10.1098/rspb.2013.0064 ↗
27. Camouflage and visual perception10.1098/rstb.2008.0218 ↗
28. An Improved YOLOv8 to Detect Moving Objects10.1109/ACCESS.2024.3393835 ↗
29. Adaptive camouflage for moving objects10.2352/J.Percept.Imaging.2021.4.2.020502 ↗
30. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2021, January 20–25). Scaled-yolov4: Scaling cross stage partial network. Proceedings of the IEEE/cvf conference on computer vision and pattern recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01283 ↗
31. Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
32. Tambunan, I.H., Silaen, D., Michael, F., Sihotang, B.A., and Sitanggang, K.G. (2022, January 19–21). Performance comparison of YOLOv4 and YOLOv4-Tiny algorithm for object detection on wheeled soccer robot. Proceedings of the 2022 IEEE International Conference of Computer Science and Information Technology (ICOSNIKOM), Laguboti, Indonesia.10.1109/ICOSNIKOM56551.2022.10034912 ↗
33. Visual search and stimulus similarity10.1037/0033-295X.96.3.433 ↗
34. Selj, G.K., and Heinrich, D.H. (2016, January 26–27). Disruptive coloration in woodland camouflage: Evaluation of camouflage effectiveness due to minor disruptive patches. Proceedings of the Target and Background Signatures II, Edinburgh, UK.10.1117/12.2241991 ↗
35. Complete and accurate holly fruits counting using YOLOX object detection10.1016/j.compag.2022.107062 ↗
36. Sun, H., Wang, B., and Xue, J. (2023). YOLO-P: An efficient method for pear fast detection in complex orchard picking environment. Front. Plant Sci., 13.10.3389/fpls.2022.1089454 ↗
37. Neural acclimation to 1/f spatial frequency spectra in natural images transduced by the human visual system10.1016/S0167-2789(99)00197-9 ↗
38. Fractal structure in the color distribution of natural images10.1016/j.chaos.2009.01.008 ↗
39. Fractal capacity dimension of three-dimensional histogram from color images10.1007/s11045-009-0097-0 ↗
40. Multifractal analysis of three-dimensional histogram from color images10.1016/j.chaos.2010.08.003 ↗
41. Relations between the statistics of natural images and the response properties of cortical cells10.1364/JOSAA.4.002379 ↗
42. Statistics of natural images categories10.1088/0954-898X_14_3_302 ↗
43. Urban camouflage assessment through visual search and computational saliency
44. Automated colour grading using colour distribution transfer10.1016/j.cviu.2006.11.011 ↗
45. World Medical Association (2013). World Medical Association declaration of Helsinki: Ethical principles for medical research involving human subjects. J. Am. Med. Assoc., 310, 2191–2194.10.1001/jama.2013.281053 ↗
46. PsychoPy—Psychophysics software in Python10.1016/j.jneumeth.2006.11.017 ↗
47. Generating stimuli for neuroscience using PsychoPy
48. Driggers, R.G. (2003). Visual search. Encyclopedia of Optical Engineering, Marcel Dekker Inc.
49. Li, M.-L., Sun, G.-B., and Yu, J.-X. (2023). A Pedestrian Detection Network Model Based on Improved YOLOv5. Entropy, 25.10.3390/e25020381 ↗
50. Detection of Camouflaged Objects Using Convolutional Neural Network
51. Zhang, W., Zhou, Q., Li, R., and Niu, F. (2022). Research on camouflaged human target detection based on deep learning. Comput. Intell. Neurosci., 2022.10.1155/2022/7703444 ↗
52. Five factors that guide attention in visual search10.1038/s41562-017-0058 ↗
53. What attributes guide the deployment of visual attention and how do they do it?10.1038/nrn1411 ↗
54. Pip and pop: Nonspatial auditory signals improve spatial visual search10.1037/0096-1523.34.5.1053 ↗
55. Poke and pop: Tactile-visual synchrony increases visual saliency10.1016/j.neulet.2008.11.002 ↗
56. Visual perception of biological motion and a model for its analysis10.3758/BF03212378 ↗
57. Visual features of intermediate complexity and their use in classification10.1038/nn870 ↗
58. Merilaita, S., Scott-Samuel, N.E., and Cuthill, I.C. (2017). How camouflage works. Philos. Trans. R. Soc. B Biol. Sci., 372.10.1098/rstb.2016.0341 ↗
59. Terven, J., and Cordova-Esparza, D. (2023). A comprehensive review of YOLO: From YOLOv1 to YOLOv8 and beyond. arXiv.
60. Object detection using YOLO: Challenges, architectural successors, datasets and applications10.1007/s11042-022-13644-y ↗
61. Chen, C., Zhu, H., Ren, Q., Luo, R., and Lan, H. (2023, January 6–8). Improved YOLO-based Pedestrian Detection Algorithm. Proceedings of the 2023 6th International Conference on Image and Graphics Processing, Chongqing, China.10.1145/3582649.3582652 ↗
62. Li, M., Chen, S., Sun, C., Fang, S., Han, J., Wang, X., and Yun, H. (2023). An Improved Lightweight Dense Pedestrian Detection Algorithm. Appl. Sci., 13.10.3390/app13158757 ↗
63. Maya-Martínez, S.-U., Argüelles-Cruz, A.-J., Guzmán-Zavaleta, Z.-J., and Ramírez-Cadena, M.-d.-J. (2023). Pedestrian detection model based on Tiny-Yolov3 architecture for wearable devices to visually impaired assistance. Front. Robot. AI, 10.10.3389/frobt.2023.1052509 ↗
64. Mishra, S., and Jabin, S. (2023, January 1–3). Real-Time Pedestrian Detection using YOLO. Proceedings of the 2023 International Conference on Recent Advances in Electrical, Electronics & Digital Healthcare Technologies (REEDCON), New Delhi, India.10.1109/REEDCON57544.2023.10151150 ↗
65. Razzok, M., Badri, A., El Mourabit, I., Ruichek, Y., and Sahel, A. (2023). Pedestrian Detection and Tracking System Based on Deep-SORT, YOLOv5, and New Data Association Metrics. Information, 14.10.3390/info14040218 ↗
66. Tang, F., Yang, F., and Tian, X. (2023). Long-Distance Person Detection Based on YOLOv7. Electronics, 12.10.3390/electronics12061502 ↗
67. Simulation of Occluded Pedestrian Detection Based on Improved YOLO
68. Zou, G., and Zhang, Z. (2023, January 15–17). Pedestrian target detection algorithm based on improved YOLO v5. Proceedings of the International Conference on Internet of Things and Machine Learning (IoTML 2023), Singapore.10.1117/12.3013616 ↗
69. Liu, Y., Wang, X., Hu, E., Wang, A., Shiri, B., and Lin, W. (2025). VNDHR: Variational Single Nighttime Image Dehazing for Enhancing Visibility in Intelligent Transportation Systems via Hybrid Regularization. IEEE Trans. Intell. Transp. Syst., 1–15.10.1109/TITS.2025.3550267 ↗
70. YOLO-G: A Lightweight Network Model for Improving the Performance of Military Targets Detection10.1109/ACCESS.2022.3177628 ↗
71. A Review of Yolo Algorithm Developments10.1016/j.procs.2022.01.135 ↗
72. Schwegmann, A. (2023, January 3–7). Evaluation of dual attribute adversarial camouflage and counter-AI reconnaissance methods in terms of more realistic spatial alignment. Proceedings of the Target and Background Signatures IX, Amsterdam, The Netherlands.10.1117/12.2679418 ↗
73. Schwegmann, A. (2022, January 5). Camouflage methods to counter artificial intelligence recognition (Conference Presentation). Proceedings of the Target and Background Signatures VIII, Berlin, Germany.10.1117/12.2638485 ↗
74. Meyes, R., Lu, M., de Puiseau, C.W., and Meisen, T. (2019). Ablation studies in artificial neural networks. arXiv.
75. Noh, H., Hong, S., and Han, B. (2015, January 7–13). Learning deconvolution network for semantic segmentation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.178 ↗
76. Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13–17). “Why Should I Trust You?”: Explaining the Predictions of Any Classifier. Proceedings of the Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939778 ↗
77. Dual Attribute Adversarial Camouflage toward camouflaged object detection10.1016/j.dt.2021.12.003 ↗
78. Motion onset captures attention10.1111/1467-9280.01458 ↗
79. The onset of receding motion captures attention: Comment on Franconeri and Simons (2003)10.3758/BF03206486 ↗
80. Unexpected changes in direction of motion attract attention10.3758/BF03196685 ↗