journal article·2021-10-25Open access

Illuminant Estimation Using Adaptive Neuro-Fuzzy Inference System

Yunhui Luo, Xingguang Wang, Qing Wang, Yehong Chen

Applied Sciences· Volume 11· Issue 21

Abstract

Computational color constancy (CCC) is a fundamental prerequisite for many computer vision tasks. The key of CCC is to estimate illuminant color so that the image of a scene under varying illumination can be normalized to an image under the canonical illumination. As a type of solution, combination algorithms generally try to reach better illuminant estimation by weighting other unitary algorithms for a given image. However, due to the diversity of image features, applying the same weighting combination strategy to different images might result in unsound illuminant estimation. To address this problem, this study provides an effective option. A two-step strategy is first employed to cluster the training images, then for each cluster, ANFIS (adaptive neuro-network fuzzy inference system) models are effectively trained to map image features to illuminant color. While giving a test image, the fuzzy weights measuring what degrees the image belonging to each cluster are calculated, thus a reliable illuminant estimation will be obtained by weighting all ANFIS predictions. The proposed method allows illuminant estimation to be dynamic combinations of initial illumination estimates from some unitary algorithms, relying on the powerful learning and reasoning capabilities of ANFIS. Extensive experiments on typical benchmark datasets demonstrate the effectiveness of the proposed approach. In addition, although there is an initial observation that some learning-based methods outperform even the most carefully designed and tested combinations of statistical and fuzzy inference systems, the proposed method is good practice for illuminant estimation considering fuzzy inference eases to implement in imaging signal processors with if-then rules and low computation efforts.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Color Science and Applications · Image Enhancement Techniques · Advanced Image Fusion Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Light Industrial Science and Engineering, Qilu University of Technology, Jinan 250353, China

Key Laboratory of Green Printing & Packaging Materials and Technology in Universities of Shandong, Qilu University of Technology, Jinan 250353, China

Funding

the Natural Science Foundation of Shandong Province, China

References (51)

Show source-provided references
1. A comparison of computational color constancy algorithms. I: Methodology and experiments with synthesized data10.1109/TIP.2002.802531 ↗
2. A comparison of computational color constancy algorithms. II. Experiments with image data10.1109/TIP.2002.802529 ↗
3. MacAdam, D.L. (1970). Influence of adaptation on the effects produced by luminous stimuli. Sources of Color Vision, The MIT Press.
4. A spatial processor model for object colour perception10.1016/0016-0032(80)90058-7 ↗
5. A spatially variant white-patch and gray-world method for color image enhancement driven by local contrast10.1109/TPAMI.2007.70827 ↗
6. The retinex theory of color vision10.1038/scientificamerican1277-108 ↗
7. Finlayson, G.D., and Trezzi, E. (2004, January 9–12). Shades of gray and colour constancy. Proceedings of the Twelfth Color Imaging Conference: Color Science and Engineering Systems, Technologies, Applications, CIC 2004, Scottsdale, AZ, USA.10.2352/CIC.2004.12.1.art00008 ↗
8. Edge-based color constancy10.1109/TIP.2007.901808 ↗
9. Color constancy using natural image statistics and scene semantics10.1109/TPAMI.2010.93 ↗
10. Automatic color constancy algorithm selection and combination10.1016/j.patcog.2009.08.007 ↗
11. Approaching the computational color constancy as a classification problem through deep learning10.1016/j.patcog.2016.08.013 ↗
12. Hu, Y., Wang, B., and Lin, S. (2017, January 21–26). FC4: Fully convolutional color constancy with confidence-weighted pooling. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA.10.1109/CVPR.2017.43 ↗
13. Afifi, M., and Brown, M.S. (2019, January 9–12). Sensor-independent illumination estimation for DNN models. Proceedings of the 30th British Machine Vision Conference 2019, BMVC 2019, Cardiff, UK.
14. Afifi, M., and Brown, M.S. (2020, January 13–19). Deep white-balance editing. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA.10.1109/CVPR42600.2020.00147 ↗
15. Deep learning-based illumination estimation using light source classification10.1109/ACCESS.2020.2992121 ↗
16. Xiao, J., Gu, S., and Zhang, L. (2020, January 13–19). Multi-domain learning for accurate and few-shot color constancy. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2020, Seattle, WA, USA.10.1109/CVPR42600.2020.00332 ↗
17. Scene illuminant estimation: Past, present, and future10.1002/col.20226 ↗
18. Evaluating combinational illumination estimation methods on real-world images10.1109/TIP.2013.2277943 ↗
19. Hybrid direct combination color constancy algorithm using ensemble of classifier10.1016/j.eswa.2018.06.038 ↗
20. Multi-objective optimization based color constancy10.1016/j.asoc.2013.11.016 ↗
21. Illumination estimation is sufficient for indoor-outdoor image classification
22. Loncaric, S., Bregovic, R., Carli, M., and Subasic, M. (2019, January 23–25). Attention-based convolutional neural network for computer vision color constancy. Proceedings of the 11th International Symposium on Image and Signal Processing and Analysis, ISPA 2019, Dubrovnik, Croatia.
23. Computational Color Constancy: Survey and Experiments10.1109/TIP.2011.2118224 ↗
24. Automatic selection of color constancy algorithms for dark image enhancement by fuzzy rule-based reasoning10.1016/j.asoc.2014.11.034 ↗
25. Illuminant estimation for color constancy: Why spatial-domain methods work and the role of the color distribution10.1364/JOSAA.31.001049 ↗
26. Efficient color constancy with local surface reflectance statistics10.1007/978-3-319-10605-2_11 ↗
27. Consensus-based framework for illuminant chromaticity estimation10.1117/1.2921013 ↗
28. Lu, R., Gijsenij, A., Gevers, T., Nedovic, V., Xu, D., and Geusebroek, J. (October, January 27). Color constancy using 3D scene geometry. Proceedings of the IEEE 12th International Conference on Computer Vision, ICCV 2009, Kyoto, Japan.
29. Stages as models of scene geometry10.1109/TPAMI.2009.174 ↗
30. Multi-cue semi-supervised color constancy with limited training samples10.1109/TIP.2020.3007823 ↗
31. van de Weijer, J., Schmid, C., and Verbeek, J.J. (2007, January 14–20). Using high-level visual information for color constancy. Proceedings of the IEEE 11th International Conference on Computer Vision, ICCV 2007, Rio de Janeiro, Brazil.10.1109/ICCV.2007.4409109 ↗
32. A supervised combination strategy for illumination chromaticity estimation10.1145/1857893.1857898 ↗
33. Cardei, V.C., and Funt, B.V. (1999, January 16–19). Committee-based color constancy. Proceedings of the Seventh Color Imaging Conference: Color Science, Systems, and Applications Putting It All Together, CIC 1999, Scottsdale, AZ, USA.
34. Illumination correction via support vector regression based on improved whale optimization algorithm10.1002/col.22601 ↗
35. Cheng, D., Price, B.L., Cohen, S., and Brown, M.S. (2015, January 7–12). Effective learning-based illuminant estimation using simple features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA.10.1109/CVPR.2015.7298702 ↗
36. Fault diagnosis of Tennessee Eastman process with multi-scale PCA and ANFIS10.1016/j.chemolab.2012.10.005 ↗
37. Determination of bubble point pressure and oil formation volume factor: Extra trees compared with LSSVM-CSA hybrid and ANFIS models10.1016/j.fuel.2019.116834 ↗
38. Providing a single ground-truth for illuminant estimation for the ColorChecker dataset10.1109/TPAMI.2019.2919824 ↗
39. Trémeau, A., Imai, F.H., and Braz, J. (2018, January 27–29). Unsupervised learning for color constancy. Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018)-Volume 4: VISAPP, Funchal, Madeira, Portugal.
40. Color constancy for uniform and non-uniform illuminant using image texture10.1109/ACCESS.2019.2919997 ↗
41. Exemplar-based color constancy and multiple illumination10.1109/TPAMI.2013.169 ↗
42. Bianco, S., Cusano, C., and Schettini, R. (2015, January 7–12). Color constancy using CNNs. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR Workshops 2015, Boston, MA, USA.10.1109/CVPRW.2015.7301275 ↗
43. Choi, H.H., Kang, H.S., and Yun, B.J. (2020). CNN-based illumination estimation with semantic information. Appl. Sci., 10.10.3390/app10144806 ↗
44. Color constancy by reweighting image feature maps10.1109/TIP.2020.2985296 ↗
45. Generalized gamut mapping using image derivative structures for color constancy10.1007/s11263-008-0171-3 ↗
46. Gehler, P.V., Rother, C., Blake, A., Minka, T.P., and Sharp, T. (2008, January 24–26). Bayesian color constancy revisited. Proceedings of the 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2008), Anchorage, AK, USA.10.1109/CVPR.2008.4587765 ↗
47. Deep specialized network for illuminant estimation10.1007/978-3-319-46493-0_23 ↗
48. Trémeau, A., Farinella, G.M., and Braz, J. (2019, January 25–27). Color beaver: Bounding illumination estimations for higher accuracy. Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2019, Volume 4: VISAPP, Prague, Czech Republic.
49. Yang, K., Gao, S., and Li, Y. (2015, January 7–12). Efficient illuminant estimation for color constancy using grey pixels. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2015, Boston, MA, USA.10.1109/CVPR.2015.7298838 ↗
50. Koscevic, K., Subasic, M., and Loncaric, S. (2020, January 17–19). Guiding the illumination estimation using the attention mechanism. Proceedings of the 2020 2nd Asia Pacific Information Technology Conference, APIT 2020, Bali Island, Indonesia.10.1145/3379310.3379329 ↗
51. Interactive white balancing for camera-rendered images