journal article·2025-03-04Open access

A Benchmark for Water Surface Jet Segmentation with MobileHDC Method

Yaojie Chen, Qing Quan, Wei Wang, Yunhan Lin

Applied Sciences· Volume 15· Issue 5

Abstract

Intelligent jet systems are widely used in various fields, including firefighting, marine operations, and underwater exploration. Accurate extraction and prediction of jet trajectories are essential for optimizing their performance, but challenges arise due to environmental factors such as climate, wind direction, and suction efficiency. To address these issues, we introduce two novel jet segmentation datasets, Libary and SegQinhu, which cover both indoor and outdoor environments under varying weather conditions and temporal intervals. These datasets present significant challenges, including occlusions and strong light reflections, making them ideal for evaluating jet trajectory segmentation methods. Through empirical evaluation of several state-of-the-art (SOTA) techniques on these datasets, we observe that general methods struggle with highly imbalanced pixel distributions in jet trajectory images. To overcome this, we propose a data-driven pipeline for jet trajectory extraction and segmentation. At its core is MobileHDC, a new baseline model that leverages the MobileNetV2 architecture and integrates dilated convolutions to enhance the receptive field without increasing computational cost. Additionally, we introduce a parallel convolutional block and a decoder to fuse multi-level features, enabling a better capture of contextual information and improving the continuity and accuracy of jet segmentation. The experimental results show that our method outperforms existing SOTA techniques on both jet-specific datasets, highlighting the effectiveness of our approach.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Anomaly Detection Techniques and Applications · Fire Detection and Safety Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan 430081, China

Hubei Province Key Laboratory of Intelligent Information Processing and Real-Time Industrial System, Wuhan 430081, China

Funding

Chinese National Natural Science Foundation · Central Science and Technology Development Project led by Hubei Province

References (42)

Show source-provided references
1. Pérez-Guerrero, C., Palacios, A., Ochoa-Ruiz, G., Mata, C., Gonzalez-Mendoza, M., and Falcón-Morales, L.E. (2021, January 25–30). Comparing machine learning based segmentation models on jet fire radiation zones. Proceedings of the Advances in Computational Intelligence: 20th Mexican International Conference on Artificial Intelligence, MICAI 2021, Mexico City, Mexico.10.1007/978-3-030-89817-5_12 ↗
2. Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016, January 27–30). The cityscapes dataset for semantic urban scene understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.350 ↗
3. Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., and Darrell, T. (2020, January 13–19). Bdd100k: A diverse driving dataset for heterogeneous multitask learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00271 ↗
4. Caesar, H., Uijlings, J., and Ferrari, V. (2018, January 18–23). Coco-stuff: Thing and stuff classes in context. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00132 ↗
5. Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., and Torralba, A. (2017, January 21–26). Scene parsing through ade20k dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.544 ↗
6. Dai, A., Chang, A.X., Savva, M., Halber, M., Funkhouser, T., and Nießner, M. (2017, January 21–26). Scannet: Richly-annotated 3d reconstructions of indoor scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.261 ↗
7. An experimental study of automatic water cannon systems for fire protection of large open spaces10.1007/s10694-013-0363-4 ↗
8. Zhu, J., Li, W., Lin, D., and Zhao, G. (2019). Real-time monitoring of jet trajectory during jetting based on near-field computer vision. Sensors, 19.10.3390/s19030690 ↗
9. Zhu, J., Pan, L., and Zhao, G. (2020). An improved near-field computer vision for jet trajectory falling position prediction of intelligent fire robot. Sensors, 20.10.3390/s20247029 ↗
10. Howard, A.G. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv.
11. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
12. Li, H., Xiong, P., Fan, H., and Sun, J. (2019, January 15–20). Dfanet: Deep feature aggregation for real-time semantic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00975 ↗
13. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
14. Gamal, M., Siam, M., and Abdel-Razek, M. (2018). Shuffleseg: Real-time semantic segmentation network. arXiv.
15. Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18–23). Shufflenet: An extremely efficient convolutional neural network for mobile devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00716 ↗
16. Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., and Sang, N. (2018, January 8–14). Bisenet: Bilateral segmentation network for real-time semantic segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01261-8_20 ↗
17. Bisenet v2: Bilateral network with guided aggregation for real-time semantic segmentation10.1007/s11263-021-01515-2 ↗
18. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs10.1109/TPAMI.2017.2699184 ↗
19. Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv.
20. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
21. Guo, Z., Bian, L., Huang, X., Wei, H., Li, J., and Ni, H. (2024). DSNet: A Novel Way to Use Atrous Convolutions in Semantic Segmentation. arXiv.10.1109/TCSVT.2024.3509504 ↗
22. Zhang, W., Huang, Z., Luo, G., Chen, T., Wang, X., Liu, W., Yu, G., and Shen, C. (2022, January 18–24). Topformer: Token pyramid transformer for mobile semantic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01177 ↗
23. RTFormer: Efficient design for real-time semantic segmentation with transformer
24. Wan, Q., Huang, Z., Lu, J., Yu, G., and Zhang, L. (2023). Seaformer: Squeeze-enhanced axial transformer for mobile semantic segmentation. arXiv.
25. The pascal visual object classes challenge: A retrospective10.1007/s11263-014-0733-5 ↗
26. Ros, G., Sellart, L., Materzynska, J., Vazquez, D., and Lopez, A.M. (2016, January 27–30). The synthia dataset: A large collection of synthetic images for semantic segmentation of urban scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.352 ↗
27. Semantic object classes in video: A high-definition ground truth database10.1016/j.patrec.2008.04.005 ↗
28. Bovcon, B., Muhovič, J., Perš, J., and Kristan, M. (2019, January 3–8). The mastr1325 dataset for training deep usv obstacle detection models. Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.10.1109/IROS40897.2019.8967909 ↗
29. Are we ready for unmanned surface vehicles in inland waterways? The usvinland multisensor dataset and benchmark10.1109/LRA.2021.3067271 ↗
30. WaterScenes: A multi-task 4d radar-camera fusion dataset and benchmarks for autonomous driving on water surfaces10.1109/TITS.2024.3415772 ↗
31. Žust, L., Perš, J., and Kristan, M. (2023, January 4–6). Lars: A diverse panoptic maritime obstacle detection dataset and benchmark. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01857 ↗
32. Liu, C., Chen, L.C., Schroff, F., Adam, H., Hua, W., Yuille, A.L., and Fei-Fei, L. (2019, January 15–20). Auto-deeplab: Hierarchical neural architecture search for semantic image segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00017 ↗
33. Wang, P., Chen, P., Yuan, Y., Liu, D., Huang, Z., Hou, X., and Cottrell, G. (2018, January 12–15). Understanding convolution for semantic segmentation. Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA.10.1109/WACV.2018.00163 ↗
34. Ding, X., Zhang, X., Han, J., and Ding, G. (2022, January 18–24). Scaling up your kernels to 31x31: Revisiting large kernel design in cnns. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01166 ↗
35. Fan, M., Lai, S., Huang, J., Wei, X., Chai, Z., Luo, J., and Wei, X. (2021, January 20–25). Rethinking bisenet for real-time semantic segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00959 ↗
36. Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv.
37. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
38. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
39. Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P.H. (2021, January 20–25). Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00681 ↗
40. SegFormer: Simple and efficient design for semantic segmentation with transformers
41. Segnext: Rethinking convolutional attention design for semantic segmentation
42. Xu, J., Xiong, Z., and Bhattacharyya, S.P. (2023, January 17–24). PIDNet: A real-time semantic segmentation network inspired by PID controllers. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01871 ↗