journal article·2025-07-07Open access

Non-Invasive Painting Pigment Classification Through Supervised Machine Learning

Michal Piotr Markowski, Solongo Gansukh, Mateusz Madry, Robert Borowiec, Jaroslaw Rogoz, Boguslaw Szczupak

Applied Sciences· Volume 15· Issue 13

Abstract

Accurate pigment classification is essential for the analysis and conservation of historical paintings. This study presents a non-invasive approach based on supervised machine learning for classifying pigments using image data acquired under three distinct spectral illumination conditions: visible-light reflectography (VIS), ultraviolet false-color imaging (UVFC), and infrared false-color imaging (IRFC). A dataset was constructed by extracting 32 × 32 pixel patches from pigment samples, resulting in 200 classes representing 40 unique pigments with five preparation variants each. A total of 600 initial raw images were acquired, from which 4000 image patches were extracted for feature engineering. Feature vectors were obtained from visible reflectography, ultraviolet false-color imaging (UVFC), and infrared false-color imaging (IRFC) using statistical descriptors derived from RGB channels. This study demonstrates that accurate pigment classification can be achieved with a minimal set of three illumination types, offering a practical and cost-effective alternative to hyperspectral imaging in real-world conservation practice. Among the evaluated classifiers, the random forest model achieved the highest accuracy (99.30 ±0.15%). The trained model was subsequently validated on annotated regions of historical paintings, demonstrating its robustness and applicability. The proposed framework offers a lightweight, interpretable, and scalable solution for non-invasive pigment analysis in cultural heritage research that can be implemented with accessible imaging hardware and minimal post-processing.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Cultural Heritage Materials Analysis · Color Science and Applications · Advanced Image Fusion Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Information and Communication Technology, Wroclaw University of Science and Technology, Wybrzeze Wyspianskiego 27, 50-370 Wroclaw, Poland

Department of Painting Technology and Techniques, Institute for Conservation, Restoration and Study of Cultural Heritage, Nicolaus Copernicus University, ul. Sienkiewicza 30/32, 87-100 Torun, Poland

Funding

Wrocław University of Science and Technology

References (27)

Show source-provided references
1. Derbyshire, A., and Withnall, R. (1999). Non-Destructive Pigment Analysis Using Raman Microscopy. V&A Conserv. J., Available online: http://www.vam.ac.uk/content/journals/conservation-journal/issue-30/non-destructive-pigment-analysis-using-raman-microscopy/.10.1002/(SICI)1097-4555(199903)30:3<185::AID-JRS357>3.0.CO;2-U ↗
2. Reflectance Hyperspectral Imaging for Investigation of Works of Art: Old Master Paintings and Illuminated Manuscripts10.1021/acs.accounts.6b00048 ↗
3. Identification of Pigments by Multispectral Imaging: A Flowchart Method10.1186/2050-7445-2-8 ↗
4. Berns, R.S., and Imai, F.H. (2001, January 6–9). The application of Kubelka-Munk theory for the digital imaging of paintings. Proceedings of the Ninth Color Imaging Conference: Color Science and Engineering Systems, Technologies, Applications, Scottsdale, AZ, USA.
5. Kleynhans, T., Messinger, D.W., Easton, R.L., and Delaney, J.K. (2021). Low-Cost Multispectral System Design for Pigment Analysis in Works of Art. Sensors, 21.10.3390/s21155138 ↗
6. Karapanagiotis, I., Amanatiadis, S.A., Apostolidis, G., and Karagiannis, G. (2021). Characterization of Color Degradation of Byzantine Pigments Due to Artificial Aging. Minerals, 11.10.3390/min11070782 ↗
7. The influence of visible light and inorganic pigments on fluorescence excitation-emission spectra of egg-, casein- and collagen-based painting media10.1007/s00339-008-4460-z ↗
8. Visible and Infrared Imaging Spectroscopy of Paintings and Improved Reflectography10.1186/s40494-016-0075-4 ↗
9. Applications of Visible Spectral Imaging Technology for Pigment Identification of Colored Relics10.1186/s40494-024-01434-8 ↗
10. Adaptive Superpixel Segmentation and Pigment Identification of Colored Relics Based on Visible Spectral Images10.1186/s40494-024-01461-5 ↗
11. Liu, L., Miteva, T., Delnevo, G., Mirri, S., Walter, P., de Viguerie, L., and Pouyet, E. (2023). Neural Networks for Hyperspectral Imaging of Historical Paintings: A Practical Review. Sensors, 23.10.3390/s23052419 ↗
12. Unmixing and Pigment Identification Using Visible and Short-Wavelength Infrared: Reflectance vs Logarithm Reflectance Hyperspaces10.1016/j.culher.2023.10.016 ↗
13. Pouyet, E., Miteva, T., Rohani, N., and de Viguerie, L. (2021). Artificial Intelligence for Pigment Classification Task in the Short-Wave Infrared Range. Sensors, 21.10.3390/s21186150 ↗
14. Deep Neural Models for Color Classification and Color Constancy10.1167/jov.22.4.17 ↗
15. Kogou, S., Shahtahmassebi, G., Lucian, A., Liang, H., Shui, B., Zhang, W., Su, B., and van Schaik, S. (2020). From Remote Sensing and Machine Learning to the History of the Silk Road: Large Scale Material Identification on Wall Paintings. Sci. Rep., 10.10.1038/s41598-020-76457-9 ↗
16. Neural Network-Based Classification of X-ray Fluorescence Spectra of Artists’ Pigments: An Approach Leveraging a Synthetic Dataset Created Using the Fundamental Parameters Method10.1186/s40494-022-00716-3 ↗
17. Deep Transfer Learning for Visual Analysis and Attribution of Paintings by Raphael10.1186/s40494-023-01094-0 ↗
18. An Alternative Approach to Mapping Pigments in Paintings with Hyperspectral Reflectance Image Cubes Using Artificial Intelligence10.1186/s40494-020-00427-7 ↗
19. Radpour, R., Kleynhans, T., Facini, M., Pozzi, F., Westerby, M., and Delaney, J.K. (2024). Advances in Automated Pigment Mapping for 15th-Century Manuscript Illuminations Using 1-D Convolutional Neural Networks and Hyperspectral Reflectance Image Cubes. Appl. Sci., 14.10.3390/app14166857 ↗
20. Taufique, A.M.N., and Messinger, D.W. (2021). Hyperspectral Pigment Analysis of Cultural Heritage Artifacts Using the Opaque Form of Kubelka-Munk Theory. arXiv.
21. Spectral Unmixing of Pigments on Surface of Painted Artefacts Considering Spectral Variability
22. Rohani, N., Pouyet, E., Walton, M., Cossairt, O., and Katsaggelos, A.K. (2019, January 12–17). Pigment Unmixing of Hyperspectral Images of Paintings Using Deep Neural Networks. Proceedings of the ICASSP 2019—2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.10.1109/ICASSP.2019.8682838 ↗
23. Haidar, S., and Oramas, J. (2023). Training Methods of Multi-label Prediction Classifiers for Hyperspectral Remote Sensing Images. arXiv.10.2139/ssrn.4332116 ↗
24. Can deep learning assist automatic identification of layered pigments from XRF data?10.1039/D2JA00246A ↗
25. Ricoh Imaging (2025, June 25). PENTAX 645Z IR Product Page. Available online: https://www.ricoh-imaging.co.jp/english/products/645z-ir/.
26. Scikit-learn: Machine Learning in Python
27. (2025, June 25). scikit-learn Developers. scikit-learn API Reference: Classifier Estimators. scikit-learn. 2025. Default hyperparameters for SVC, SGDClassifier, DecisionTreeClassifier, RandomForestClassifier, ExtraTreesClassifier, AdaBoostClassifier, BaggingClassifier, KNeighborsClassifier, LogisticRegression, GaussianNB (Version 1.7.0). Available online: https://scikit-learn.org/stable/modules/generated/sklearn.ensemble.RandomForestClassifier.html.