An Adaptive Threshold for the Canny Edge with Weak Label
Source abstract
Abstract
Edge detection is critical in various computer vision applications such as object recognition, segmentation, and scene understanding. The Canny edge detector remains widely used in traditional methods due to its balance between accuracy and computational efficiency. However, optimal performance depends heavily on carefully selecting three threshold parameters. Prior studies have proposed reinforcement learning-based approaches to automatically determine these parameters. Still, they rely on a supervised edge evaluation network that requires manually annotated high-quality edge labels—a costly and time-consuming prerequisite. This paper proposes a novel approach that eliminates the need for manually labeled data by introducing a weakly supervised reward scheme. We automatically generate weak edge labels from gradient information and use them as pseudo ground truth to compute reward values during the reinforcement learning process. The proposed method leverages an Actor-Critic algorithm to learn adaptive thresholds for the Canny edge detector without explicit supervision. Experimental results demonstrate that our method achieves comparable or superior edge detection performance compared to previous supervised methods and generalizes effectively to unseen datasets.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Medical Image Segmentation Techniques · Advanced Neural Network Applications · Image and Object Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Graduate School of Automotive Engineering, Seoul National University of Science and Technology, Seoul 01811, Republic of Korea
Department of Mechanical and Automotive Engineering, Seoul National University of Science and Technology, Seoul 01811, Republic of Korea
Funding
Research Program funded by the SeoulTech
References (43)
Show source-provided references
1. Arbelaez, P., Pont-Tuset, J., Barron, J., Marques, F., and Malik, J. (2014, January 24–27). Multi-scale combinatorial grouping. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.49 ↗
2. Chen, L.C., Barron, J.T., Papandreou, G., Murphy, K., and Yuille, A.L. (2016, January 27–30). Semantic image segmentation with task-specific edge detection using CNNs and a discriminatively trained domain transform. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.492 ↗
3. Coastline extraction from SAR images using spatial fuzzy clustering and the active contour method10.1080/01431161.2016.1266104 ↗
4. Using street based metrics to characterize urban topologies10.1016/j.compenvurbsys.2013.12.002 ↗
5. A computational approach to edge detection
6. Statistical edge detection: Learning and evaluating edge cues10.1109/TPAMI.2003.1159946 ↗
7. Shen, W., Wang, X., Wang, Y., Bai, X., and Zhang, Z. (2015, January 7–12). Deepcontour: A deep convolutional feature learned by positive sharing loss for contour detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.
8. Bertasius, G., Shi, J., and Torresani, L. (2015, January 7–12). Deepedge: A multi-scale bifurcated deep network for top-down contour detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7299067 ↗
9. Xie, S., and Tu, Z. (2015, January 7–13). Holistically-nested edge detection. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.164 ↗
10. An adaptive threshold for the Canny algorithm with deep reinforcement learning10.1109/ACCESS.2021.3130132 ↗
11. An adaptive threshold for the Canny edge with actor-critic algorithm10.1109/ACCESS.2023.3291593 ↗
12. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
13. Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., and Riedmiller, M. (2013). Playing atari with deep reinforcement learning. arXiv.
14. Simple statistical gradient-following algorithms for connectionist reinforcement learning10.1023/A:1022672621406 ↗
15. Degris, T., Pilarski, P.M., and Sutton, R.S. (2012, January 27–29). Model-free reinforcement learning with continuous action in practice. Proceedings of the American Control Conference (ACC), Montreal, QC, Canada.10.1109/ACC.2012.6315022 ↗
16. Mnih, V., Badia, A.P., Mirza, M., Graves, A., Harley, T., Lillicrap, T.P., Silver, D., and Kavukcuoglu, K. (2016, January 19–24). Asynchronous method for deep reinforcement learning. Proceedings of the International Conference on Machine Learning (ICML), New York City, NY, USA.
17. Learning to detect natural image boundaries using local brightness, color and texture cues10.1109/TPAMI.2004.1273918 ↗
18. Contour detection and hierarchical image segmentation10.1109/TPAMI.2010.161 ↗
19. Dollar, P., Tu, Z., and Belongie, S. (2006, January 17–22). Supervised learning of edges and object boundaries. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New York City, NY, USA.
20. Ren, X. (2008, January 12–18). Multi-scale improves boundary detection in natural images. Proceedings of the European Conference on Computer Vision, Marseille, France.10.1007/978-3-540-88690-7_40 ↗
21. Lim, J.J., Zitnick, C.L., and Doll´ar, P. (2013, January 23–28). Sketch tokens: A learned mid-level representation for contour and object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.406 ↗
22. Fast edge detection using structured forests10.1109/TPAMI.2014.2377715 ↗
23. Xu, D., Ouyang, W., Alameda-Pineda, X., Ricci, E., Wang, X., and Sebe, N. (2017, January 4–9). Learning deep structured multi-scale features using attention-gated crfs for contour prediction. Proceedings of the Conference on Neural Information Processing Systems, Long Beach, CA, USA.
24. He, J., Zhang, S., Yang, M., Shan, Y., and Huang, T. (2019, January 15–20). Bi-directional cascade network for perceptual edge detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00395 ↗
25. A modified Canny algorithm for detecting sky-sea line in infrared images
26. Fang, M., Yue, G.X., and Yu, Q.C. (2009, January 10–12). The study on an application of Otsu method in Canny operator. Proceedings of the ISIP ‘09, Geneva, Switzerland.
27. Threshold selection method from gray-level histograms10.1109/TSMC.1979.4310076 ↗
28. Huo, Y.K., Wei, G., Zhang, Y.D., and Wu, L.N. (July, January 30). An adaptive threshold for the Canny operator of edge detection. Proceedings of the International Conference on Image Analysis and Signal Processing, Trois-Rivières, QC, Canada.
29. Lu, X., Yao, J., Li, K., and Li, L. (2015, January 27–30). Cannylines: A parameter-free line segment detector. Proceedings of the IEEE International Conference on Image Processing, Québec City, QC, Canada.10.1109/ICIP.2015.7350850 ↗
30. A method for objective edge detection evaluation and detector parameter selection10.1109/TPAMI.2003.1217608 ↗
31. Determining hysteresis thresholds for edge detection by combining the advantages and disadvantages of threshold methods10.1109/TIP.2009.2032942 ↗
32. A novel method to look for the hysteresis thresholds for the Canny edge detector10.1016/j.patcog.2010.12.008 ↗
33. Sutton, R.S., and Barto, A.G. (2018). Introduction to Reinforcement Learning, MIT Press. [2nd ed.].
34. Deep learning10.1038/nature14539 ↗
35. Mastering the game of go with deep neural networks and tree search10.1038/nature16961 ↗
36. Mastering the game of go without human knowledge10.1038/nature24270 ↗
37. A general reinforcement learning algorithm that masters chess, shogi, and go through self-play10.1126/science.aar6404 ↗
38. Caicedo, J.C., and Lazebnik, S. (2015, January 7–13). Active object localization with deep reinforcement learning. Proceedings of the International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.286 ↗
39. Tree-structured reinforcement learning for sequential object localization
40. Yun, S., Choi, J., Yoo, Y., Yun, K., and Young Choi, J. (2017, January 21–26). Action-decision networks for visual tracking with deep reinforcement learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.148 ↗
41. Baddeley, A.J. (1992). An error metric for binary images. Robust Computer Vision: Quality of Vision Algorithms, Wichmann Verlag.
42. Xu, N., Yang, L., Fan, Y., Yang, J., Yue, D., Liang, Y., Price, B., Cohen, S., and Huang, T. (2018, January 8–14). YouTube-VOS: Sequence-to-sequence video object segmentation. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01228-1_36 ↗
43. Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., and Darrel, T. (2018). BDD100K: A diverse driving database for heterogeneous multitask learning. arXiv.