Automatic Salient Object Extraction Based on Locally Adaptive Thresholding to Generate Tactile Graphics
Source abstract
Abstract
Automatic extraction of salient regions is beneficial for various computer vision applications, such as image segmentation and object recognition. The salient visual information across images is very useful and plays a significant role for the visually impaired in identifying tactile information. In this paper, we introduce a novel saliency cuts method using local adaptive thresholding to obtain four regions from a given saliency map. First, we produced four regions for image segmentation using a saliency map as an input image and local adaptive thresholding. Second, the four regions were used to initialize an iterative version of the GrabCuts algorithm and to produce a robust and high-quality binary mask with a full resolution. Finally, salient objects’ outer boundaries and inner edges were detected using the solution from our previous research. Experimental results showed that local adaptive thresholding using integral images can produce a more robust binary mask compared to the results from previous works that make use of global thresholding techniques for salient object segmentation. The proposed method can extract salient objects with a low-quality saliency map, achieving a promising performance compared to existing methods. The proposed method has advantages in extracting salient objects and generating simple, important edges from natural scene images efficiently for delivering visually salient information to the visually impaired.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Visual Attention and Saliency Detection · Tactile and Sensory Interactions · CCD and CMOS Imaging Sensors
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of IT Convergence Engineering, Gachon University, Sujeong-Gu, Seongnam-Si, Gyeonggi-Do 461-701, Korea
Department of Hardware and Software of Management Systems in Telecommunications, Tashkent University of Information Technologies named after Muhammad al-Khwarizmi, Tashkent 100200, Uzbekistan
Department of Computer Science, Gachon University, Sujeong-Gu, Seongnam-Si, Gyeonggi-Do 461-701, Korea
References (54)
Show source-provided references
1. Rahtu, E., Kannala, J., Salo, M., and Heikkila, J. (2010, January 5–11). Segmenting Salient Objects from Images and Videos. Proceedings of the 11th European Conference on Computer Vision, Heraklion, Greece.10.1007/978-3-642-15555-0_27 ↗
2. A Novel Multiresolution Spatiotemporal Saliency Detection Model and Its Applications in Image and Video Compression10.1109/TIP.2009.2030969 ↗
3. Retargeting Images and Video for Preserving Information Saliency10.1109/MCG.2007.133 ↗
4. Saliency Detection in the Compressed Domain for Adaptive Image Retargeting10.1109/TIP.2012.2199126 ↗
5. Khamdamov, U., and Zaynidinov, H. (2018, January 6–9). Parallel Algorithms for Bitmap Image Processing Based on Daubechies Wavelets. Proceedings of the 2018 10th International Conference on Communication Software and Networks (ICCSN), Chengdu, China.10.1109/ICCSN.2018.8488270 ↗
6. Database Saliency for Fast Image Retrieval10.1109/TMM.2015.2389616 ↗
7. Structured Saliency Fusion Based on Dempster–Shafer Theory10.1109/LSP.2015.2399621 ↗
8. Donoser, M., Urschler, M., Hirzer, M., and Bischof, H. (October, January 29). Saliency Driven Total Variation Segmentation. Proceedings of the IEEE 12th International Conference on Computer Vision, Kyoto, Japan.
9. Rutishauser, U., Walther, D., Koch, C., and Perona, P. (July, January 27). Is bottom-up attention useful for object recognition?. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Washington, DC, USA.
10. Region-Based Saliency Detection and Its Application in Object Recognition10.1109/TCSVT.2013.2280096 ↗
11. Mukhiddinov, M., Akmuradov, B., and Djuraev, O. (2019, January 4–6). Robust Text Recognition for Uzbek Language in Natural Scene Images. Proceedings of the 2019 International Conference on Information Science and Communications Technologies (ICISCT), Tashkent, Uzbekistan.10.1109/ICISCT47635.2019.9011892 ↗
12. Sharma, G., Jurie, F., and Schmid, C. (2012, January 16–21). Discriminative Spatial Saliency for Image Classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.10.1109/CVPR.2012.6248093 ↗
13. Ma, Z., Qing, L., Miao, J., and Chen, X. (July, January 28). Advertisement evaluation using visual saliency based on foveated image. Proceedings of the IEEE Conference on Multimedia and Expo, New York, NY, USA.
14. Ghariba, B., Shehata, M.S., and McGuire, P. (2019). Visual Saliency Prediction Based on Deep Learning. Information, 10.10.3390/info10080257 ↗
15. Salient Region Extraction based on Global Contrast Enhancement and Saliency Cut for Image Information Recognition of the Visually Impaired
16. Li, S., Ju, R., Ren, T., and Wu, G. (2015, January 27–30). Saliency Cut based on adabtive triple thresholding. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada.10.1109/ICIP.2015.7351680 ↗
17. Global contrast based salient region detection10.1109/TPAMI.2014.2345401 ↗
18. Fu, Y., Cheng, J., Li, Z., and Lu, H. (2008, January 8–11). Saliency cuts: An automatic approach to object segmentation. Proceedings of the 2008 19th International Conference on Pattern Recognition (ICPR), Tampa, FL, USA.
19. Local Contrast and Mean based Thresholding technique in Image Binarization
20. “GrabCut”: Interactive foreground extraction using iterated graph cuts10.1145/1015706.1015720 ↗
21. Hierarchical Image Saliency Detection on Extended CSSD10.1109/TPAMI.2015.2465960 ↗
22. Efficient graph-based image segmentation10.1023/B:VISI.0000022288.19776.77 ↗
23. Mean shift: A robust approach toward feature space analysis10.1109/34.1000236 ↗
24. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., and Susstrunk, S. (2010). SLIC Superpixels, EPFL. EPFL Technical Report No. 149300.
25. Object-based attention: Saliency detection using contrast via background prototypes10.1049/el.2014.0903 ↗
26. Zhou, Q., Chen, J., Ren, S., Zhou, Y., Chen, J., and Liu, W. (2013, January 15–18). On Contrast Combinations for Visual Saliency Detection. Proceedings of the 2013 IEEE International Conference on Image Processing (ICIP), Melbourne, Australia.10.1109/ICIP.2013.6738549 ↗
27. Background Prior-Based Salient Object Detection via Deep Reconstruction Residual10.1109/TCSVT.2014.2381471 ↗
28. Lee, G., Tai, Y.-W., and Kim, J. (July, January 26). Deep saliency with encoded low level distance map and high level features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
29. Li, G., and Yu, Y. (2015, January 7–12). Visual Saliency Based on Multiscale Deep Features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.
30. Liu, N., and Han, J. (2016, January 27–30). DHSNet: Deep Hierarchical Saliency Network for Salient Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.80 ↗
31. Dense and Sparse Labelling with Multi-Dimensional Features for Saliency Detection10.1109/TCSVT.2016.2646720 ↗
32. Li, G., and Yu, Y. (2016, January 27–30). Deep Contrast Learning for Salient Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.58 ↗
33. Mehrani, P., and Veksler, O. (September, January 31). Saliency segmentation based on learning and graph cut refinement. Proceedings of the British Machine Vision Conference, Aberystwyth, UK.
34. Ko, B.C., and Nam, J.-Y. (2006, January 20–24). Automatic Object-of-Interest segmentation from natural images. Proceedings of the 18th International Conference on Pattern Recognition, Hong Kong, China.
35. Jiang, H., Wang, J., Yuan, Z., Liu, T., and Zheng, N. (September, January 29). Automatic Salient Object Segmentation based on Context and Shape Prior. Proceedings of the British Machine Vision Conference, University of Dundee, Dundee, UK.
36. Aytekin, Ç., Ozan, E.C., Kiranyaz, S., and Gabbouj, M. (2015, January 27–30). Visual Saliency by Extended Quantum Cuts. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada.10.1109/ICIP.2015.7351089 ↗
37. Winn, J., and Jojic, N. (2005, January 17–21). LOCUS: Learning Object Classes with Unsupervised Segmentation. Proceedings of the 10th IEEE International Conference on Computer Vision, Beijing, China.10.1109/ICCV.2005.148 ↗
38. Normalized Cuts and Image Segmentation10.1109/34.868688 ↗
39. Peng, J., Shen, J., and Jia, Y. (2013, January 1–8). Saliency Cut in Stereo Images. Proceedings of the IEEE International Conference on Computer Vision (ICCV) Workshops, Sydney, Australia.10.1109/ICCVW.2013.10 ↗
40. Random Walks for Image Segmentation10.1109/TPAMI.2006.233 ↗
41. Chew, S.E., and Cahill, N.D. (2015, January 7–13). Semi-Supervised Normalized Cuts for Image Segmentation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.200 ↗
42. Unsupervised Extraction of Visual Attention objects in Color Images10.1109/TCSVT.2005.859028 ↗
43. A threshold selection method from gray-level histograms
44. Wellner, P.D. (1993). Adaptive Thresholding for the DigitalDesk, Rank Xerox Ltd.
45. Adaptive document image binarization10.1016/S0031-3203(99)00055-2 ↗
46. Adaptive thresholding using the integral image10.1080/2151237X.2007.10129236 ↗
47. Peuwnuan, K., Woraratpanya, K., and Pasupa, K. (2016, January 13–15). Modified Adaptive Thresholding using integral image. Proceedings of the 13th International Joint Conference on Computer Science and Softare Engineering, Khon Kaen, Thailand.10.1109/JCSSE.2016.7748917 ↗
48. Benny, D., and Soumya, K.R. (2015, January 19–20). New Local Adaptive Thresholding and Dynamic Self-Organizing Feature Map Techniques for Handwritten Character Recognizer. Proceedings of the International Conference on Circuit, Power and Computing Technologies, Nagercoil, India.10.1109/ICCPCT.2015.7159293 ↗
49. Biswas, B., Bhattacharya, U., and Chaudhuri, B.B. (2014, January 24–28). A Global-to-Local Approach to Binarization of Degraded Document Images. Proceedings of the 22nd International Conference on Pattern Recognition, Stockholm, Sweden.10.1109/ICPR.2014.519 ↗
50. Takagi, N., and Chen, J. (2013, January 22–24). A Broken Line Classification Method of Mathematical Graphs for Automating Translation into Scalable Vector Graphic. Proceedings of the IEEE 43rd International Symposium on Multiple-Valued Logic, Toyama, Japan.10.1109/ISMVL.2013.3 ↗
51. Jungil, J., Hongchan, Y., Hyelim, L., and Jinsoo, C. (2015, January 9–12). Graphic haptic electronic board-based education assistive technology system for blind people. Proceedings of the 2015 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.10.1109/ICCE.2015.7066447 ↗
52. Chen, J., and Takagi, N. (2013, January 13–16). A Pattern Recognition Method for Automating Tactile Graphics Translation from Hand-drawn Maps. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Manchester, UK.10.1109/SMC.2013.711 ↗
53. Takagi, N., and Chen, J. (2014, January 5–8). Character string extraction from scene images by eliminating non-character elements. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, San Diego, CA, USA.10.1109/SMC.2014.6974503 ↗
54. Automatic detection of particle size distribution by image analysis based on local adaptive canny edge detection and modified circular Hough transform10.1016/j.micron.2017.12.002 ↗