Efficient Adverse-Weather Restoration for Unified-Memory Edge GPUs via Memory-Traffic-Aware Fusion
Source abstract
Abstract
Adverse-weather image restoration is increasingly needed in edge vision systems, yet many recent methods are developed primarily for accuracy on server-class hardware rather than efficient deployment on resource-constrained platforms. This gap is particularly important for unified-memory edge GPUs, where memory traffic, activation movement, and latency variability can become major bottlenecks during inference. To address this issue, this paper presents an efficient adverse-weather restoration framework for unified-memory edge GPUs based on a memory-traffic-aware fusion strategy. Instead of relying on heavy multi-branch interaction or traffic-intensive feature aggregation, the proposed design emphasizes compact feature exchange, activation-aware computation, and hardware-friendly luminance modulation under constrained memory bandwidth. The framework is developed to preserve restoration quality while reducing unnecessary intermediate data movement, thereby improving runtime efficiency and practical deployability on edge devices. Experiments on ACDC show that the proposed MW-DSNet improves downstream semantic segmentation robustness to 49.8% mIoU under a fixed segmentation head, outperforming the no-restoration input by +6.9 points and TransWeather by +0.8 points. On the NVIDIA Jetson Orin Nano (NVIDIA Corporation, Santa Clara, CA, USA) under the 15 W mode, the FP16 TensorRT engine sustains 30.0 FPS at 720p with 35.1 ms p95 latency, 36.8 ms p99 latency, and 650 MB/frame DRAM traffic. INT8 deployment with night heavy calibration further improves throughput to 42.5 FPS and reduces DRAM traffic to 380 MB/frame while limiting the mIoU drop to 1.7 points. These measured results indicate that memory-traffic-aware fusion and luminance-conditioned modulation provide a practical accuracy–efficiency trade-off for unified-memory edge GPUs.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Image Enhancement Techniques · Advanced Neural Network Applications · Advanced Image Fusion Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science and Information Engineering, Chang Jung Christian University, Tainan City 711, Taiwan
Funding
National Science and Technology Council
References (55)
Show source-provided references
1. Federal Highway Administration (FHWA) (2025, December 25). Low Visibility. Road Weather Management Program, Available online: https://ops.fhwa.dot.gov/weather/weather_events/low_visibility.htm.
2. Hitting the memory wall: Implications of the obvious10.1145/216585.216588 ↗
3. Surantha, N., and Sutisna, N. (2025). Key Considerations for Real-Time Object Recognition on Edge Computing Devices. Appl. Sci., 15.10.3390/app15137533 ↗
4. A survey on optimized implementation of deep learning models on the NVIDIA Jetson platform10.1016/j.sysarc.2019.01.011 ↗
5. A survey of techniques for optimizing deep learning on GPUs10.1016/j.sysarc.2019.101635 ↗
6. Benchmarking deep learning inference on edge devices10.1016/j.sysarc.2020.101896 ↗
7. Optimum: Runtime optimization for multiple mixed model deployment deep learning inference10.1016/j.sysarc.2023.102901 ↗
8. DeepMaker: A multi-objective optimization framework for deep neural networks in embedded systems10.1016/j.micpro.2020.102989 ↗
9. Şahin, M.C., and Tarhan, A.K. (2025). Evaluation and Selection of Hardware and AI Models for Edge Applications: A Method and A Case Study on UAVs. Appl. Sci., 15.10.3390/app15031026 ↗
10. Roofline: An insightful visual performance model for multicore architectures10.1145/1498765.1498785 ↗
11. Beyond the Roofline: Cache-Aware Power and Energy-Efficiency Modeling for Multi-Core10.1109/TC.2016.2582151 ↗
12. Li, B., Peng, X., Wang, Z., Xu, J., and Feng, D. (2017, January 22–29). AOD-Net: All-in-one dehazing network. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.511 ↗
13. Qin, H., Wang, X., Bai, L., Xie, X., and Jia, H. (2020, January 7–12). FFA-Net: Feature fusion attention network for single image dehazing. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6865 ↗
14. Valanarasu, J., Yasarla, P., and Patel, V. (2022, January 18–24). TransWeather: Transformer-based restoration of images degraded by adverse weather conditions. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.
15. DehazeNet: An end-to-end system for single image haze removal10.1109/TIP.2016.2598681 ↗
16. Ren, W., Liu, S., Zhang, H., Pan, J., Cao, X., and Yang, M.-H. (2016). Single image dehazing via multi-scale convolutional neural networks. Computer Vision—ECCV 2016, Springer.10.1007/978-3-319-46475-6_10 ↗
17. Liu, X., Ma, Y., Shi, Z., and Chen, J. (November, January 27). GridDehazeNet: Attention-based multi-scale network for image dehazing. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.10.1109/ICCV.2019.00741 ↗
18. Dong, H., Pan, J.S., Xiang, L., Hu, Z., Zhang, X.Y., and Wang, F. (2020, January 13–19). Multi-scale boosted dehazing network with dense feature fusion. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00223 ↗
19. Wu, H., Qu, Y., Lin, S., Zhou, J., Qiao, R., Zhang, Z., Xie, Y., and Ma, L. (2021, January 19–25). Contrastive Learning for Compact Single Image Dehazing. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual. Available online: https://openaccess.thecvf.com/content/CVPR2021/html/Wu_Contrastive_Learning_for_Compact_Single_Image_Dehazing_CVPR_2021_paper.html.10.1109/CVPR46437.2021.01041 ↗
20. Guo, C.L., Li, C.Y., Guo, J.C., Loy, C.C., Hou, J.H., and Kwong, S. (2020, January 13–19). Zero-reference deep curve estimation for low-light image enhancement. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00185 ↗
21. Wei, C., Wang, W., Yang, W., and Liu, J. (2018). Deep retinex decomposition for low-light enhancement. British Machine Vision Conference, BMVA Press.
22. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., and Yang, M.-H. (2021, January 20–25). Multi-stage progressive image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01458 ↗
23. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., and Yang, M.-H. (2022, January 18–24). Restormer: Efficient transformer for high-resolution image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00564 ↗
24. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
25. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018). CBAM: Convolutional block attention module. Computer Vision—ECCV 2018, Springer.10.1007/978-3-030-01234-2_1 ↗
26. Sun, S., Ren, W., Gao, X., Wang, R., and Cao, X. (2024). Restoring Images in Adverse Weather Conditions via Histogram Transformer. Computer Vision—ECCV 2024, Springer.10.1007/978-3-031-72670-5_7 ↗
27. Guo, H., Li, J., Dai, T., Ouyang, Z., Ren, X., and Xia, S.-T. (2024). MambaIR: A simple baseline for image restoration with state-space model. Computer Vision—ECCV 2024, Springer.10.1007/978-3-031-72649-1_13 ↗
28. Potlapalli, V., Zamir, S.W., Khan, S., and Khan, F.S. (2023). PromptIR: Prompting for all-in-one blind image restoration. Advances in Neural Information Processing Systems, Curran Associates, Inc.
29. Jiang, Y.T., Zhang, Z.Y., Xue, T.F., and Gu, J.W. (2024). AutoDIR: Automatic all-in-one image restoration with latent diffusion. Computer Vision—ECCV 2024, Springer.10.1007/978-3-031-73661-2_19 ↗
30. Restoring vision in adverse weather conditions with patch-based denoising diffusion models10.1109/TPAMI.2023.3238179 ↗
31. Han, S., Mao, H., and Dally, W.J. (2016, January 2–4). Deep compression: Compressing deep neural networks with pruning, trained quantization and Huffman coding. Proceedings of the 4th International Conference on Learning Representations (ICLR), San Juan, Puerto Rico.
32. Jacob, B., Kligys, S., Chen, B., Zhu, M.L., Tang, M., and Howard, A. (2018, January 18–23). Quantization and training of neural networks for efficient integer-arithmetic-only inference. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00286 ↗
33. Single image haze removal using dark channel prior10.1109/TPAMI.2010.168 ↗
34. Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., and Sang, N. (2018). BiSeNet: Bilateral segmentation network for real-time semantic segmentation. Computer Vision—ECCV 2018, Springer.10.1007/978-3-030-01261-8_20 ↗
35. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18–23). MobileNetV2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
36. Ma, N., Zhang, X., Zheng, H.-T., and Sun, J. (2018, January 8–14). ShuffleNet V2: Practical guidelines for efficient CNN architecture design. Proceedings of the 15th European Conference, Munich, Germany.10.1007/978-3-030-01264-9_8 ↗
37. Tan, M., and Le, Q.V. (2019, January 9–15). EfficientNet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, Long Beach, CA, USA.
38. Ding, X.H., Zhang, X.Y., Ma, N.N., Han, J.G., Ding, G.G., and Sun, J. (2021, January 20–25). RepVGG: Making VGG-style ConvNets great again. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01352 ↗
39. Horowitz, M. (2014, January 9–13). Computing’s energy problem (and what we can do about it). Proceedings of the 2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers (ISSCC), San Francisco, CA, USA.10.1109/ISSCC.2014.6757323 ↗
40. NVIDIA (2025, December 25). TensorRT Developer Guide. Release 10.4.0. Available online: https://docs.nvidia.com/deeplearning/tensorrt/developer-guide/index.html.
41. Sakaridis, C., Dai, D., and Van Gool, L. (2021, January 10–17). ACDC: The adverse conditions dataset with correspondences for semantic driving scene understanding. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.01059 ↗
42. Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., and Benenson, R. (2016, January 27–30). The Cityscapes dataset for semantic urban scene understanding. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.350 ↗
43. Sakaridis, C., Dai, D., and Van Gool, L. (November, January 27). Guided curriculum model adaptation and uncertainty-aware evaluation for semantic nighttime image segmentation. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.10.1109/ICCV.2019.00747 ↗
44. Hinton, G., Vinyals, O., and Dean, J. (2015, January 7–12). Distilling the knowledge in a neural network. Proceedings of the NIPS Deep Learning and Representation Learning Workshop, Montreal, QC, Canada.
45. Normalization as a canonical neural computation10.1038/nrn3136 ↗
46. NVIDIA (2025, December 25). Jetson Orin Nano Developer Kit. NVIDIA Developer. Available online: https://developer.nvidia.com/embedded/learn/get-started-jetson-orin-nano-devkit.
47. Semantic foggy scene understanding with synthetic data10.1007/s11263-018-1072-8 ↗
48. Early stopping—But when?
49. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
50. NVIDIA (2026, January 06). NVIDIA Jetson Orin Nano Developer Kit Gets a Super Boost. NVIDIA Technical Blog, Available online: https://developer.nvidia.com/blog/nvidia-jetson-orin-nano-developer-kit-gets-a-super-boost/.
51. NVIDIA (2025, December 25). Jetson Linux Developer Guide: Platform Power and Performance. Jetson Linux Developer Guide (Jetson Linux r36.2). Available online: https://docs.nvidia.com/jetson/archives/r36.2/DeveloperGuide/SD/PlatformPowerAndPerformance.html.
52. NVIDIA (2025, December 25). Jetson Linux Developer Guide: Tegrastats Utility. Jetson Linux Development Tools. Available online: https://docs.nvidia.com/jetson/archives/r36.2/DeveloperGuide/AT/JetsonLinuxDevelopmentTools/TegrastatsUtility.html.
53. Random search for hyper-parameter optimization
54. Statistical comparisons of classifiers over multiple data sets
55. Approximate statistical tests for comparing supervised classification learning algorithms10.1162/089976698300017197 ↗