Experimental Evaluation of Display Field Communication Based on Machine Learning and Modem Design
Source abstract
Abstract
Display field communication (DFC) is a frequency-domain unobtrusive display-to-camera (D2C) communication, in which an electronic display serves as a transmitter and a camera serves as a receiver. In this paper, we propose a machine learning-based DFC scheme and evaluate its performance in a lab test scenario. First of all, we adopt the Discrete Cosine Transform (DCT) to transform a spatial-domain image into its spectral-domain equivalent. To reduce the computational complexity during the data-embedding process, addition allocation and subtraction data retrieval techniques are used. Moreover, channel coding is applied to overcome the data error caused by the optical wireless channel. In particular, robust turbo coding is used for error detection and correction. Afterward, we perform the experiments to validate the performance of the proposed system. After capturing the displayed image with a camera, data restoration is done using a deep learning technique. Extensive real-world experiments were performed considering various geometric distortions, noise, and different standard input images. As a result, we found that by increasing the transmit display image size (upsampling), the overall error rate can be reduced. In addition, real-world noise analysis is performed and it is notified that the actual noise is dominant in the low-frequency region of an image. The experimental results confirm the robust performance of the proposed DFC scheme and show that an error-free performance can be achieved up to a distance of 1 m in the given lab test environment setting.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Optical Wireless Communication Technologies · Image and Video Quality Assessment · Video Coding and Compression Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electronic Engineering, Yeungnam University, Gyeongsan 38541, Republic of Korea
Funding
Gyeongbuk Regional Wind Energy Cluster Human Resources Development Project · National Research Foundation of Korea (NRF) grant
References (42)
Show source-provided references
1. TERA: Screen-to-Camera Image Code With Transparency, Efficiency, Robustness and Adaptability10.1109/TMM.2021.3061801 ↗
2. Guri, M., Bykhovsky, D., and Elovici, Y. (2019, January 28–29). BRIGHTNESS: Leaking sensitive data from air-gapped workstations via screen brightness. Proceedings of the 2019 12th CMI Conference on Cybersecurity and Privacy (CMI), Copenhagen, Denmark.10.1109/CMI48017.2019.8962137 ↗
3. Robust and unobtrusive display-to-camera communications via blue channel embedding10.1109/TIP.2018.2865681 ↗
4. Complementary Color Barcode-Based Optical Camera Communications10.1155/2020/3898427 ↗
5. Marktscheffel, T., Gottschlich, W., Popp, W., Werli, P., Fink, S.D., Bilzhause, A., and de Meer, H. (2016, January 21–24). QR code based mutual authentication protocol for Internet of Things. Proceedings of the 2016 IEEE 17th International Symposium on A World of Wireless, Mobile and Multimedia Networks (WoWMoM), Coimbra, Portugal.10.1109/WoWMoM.2016.7523562 ↗
6. (2015). Information Technology Automatic Identification and Data Capture Techniques QR Code Bar Code Symbology Specification (Standard No. ISO/IEC 18004:2015).
7. Kamijo, K., Kamijo, N., and Gang, Z. (2008, January 12–15). Invisible barcode with optimized error correction. Proceedings of the 2008 15th IEEE International Conference on Image Processing, San Diego, CA, USA.10.1109/ICIP.2008.4712185 ↗
8. Mohan, A., Woo, G., Hiura, S., Smithwick, Q., and Raskar, R. (2009). Bokode: Imperceptible visual tags for camera based interaction from a distance. ACM SIGGRAPH 2009 Papers, Association for Computing Machinery.10.1145/1576246.1531404 ↗
9. Hao, T., Zhou, R., and Xing, G. (2012, January 25–29). COBRA: Color barcode streaming for smartphone systems. Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services, Low Wood Bay, Lake District, UK.10.1145/2307636.2307645 ↗
10. Display field communication: Fundamental design and performance analysis10.1109/JLT.2015.2499186 ↗
11. Implementation of two-dimensional display field communications for enhancing the achievable data rate in smart-contents transmission10.1016/j.displa.2018.07.006 ↗
12. Performance Analysis of Display Field Communication with Advanced Receivers10.1155/2020/3657309 ↗
13. Fuzzy Parameterized Fuzzy Soft k-Nearest Neighbor Classifier10.1016/j.neucom.2022.05.041 ↗
14. A classification method in machine learning based on soft decision-making via fuzzy parameterized fuzzy soft matrices10.1007/s00500-021-06553-z ↗
15. A new classification method using soft decision-making based on an aggregation operator of fuzzy parameterized fuzzy soft matrices10.55730/1300-0632.3816 ↗
16. A precise and stable machine learning algorithm: Eigenvalue classification (EigenClass)10.1007/s00521-020-05343-2 ↗
17. Numerical data classification via distance-based similarity measures of fuzzy parameterized fuzzy soft matrices10.1109/ACCESS.2021.3089849 ↗
18. Tamang, L.D., and Kim, B.W. (2021). Spectral Domain-Based Data-Embedding Mechanisms for Display-to-Camera Communication. Electronics, 10.10.3390/electronics10040468 ↗
19. Li, T., An, C., Xiao, X., Campbell, A.T., and Zhou, X. (2015, January 19–22). Real-time screen-camera communication behind any scene. Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services, Florence, Italy.10.1145/2742647.2742667 ↗
20. Carvalho, R., Chu, C.H., and Chen, L.J. (2014, January 26–27). IVC: Imperceptible video communication. Proceedings of the Fifteenth Workshop on Mobile Computing Systems and Applications (ACM HotMobile 2014), Santa Barbara, CA, USA.
21. Wang, A., Peng, C., Zhang, O., Shen, G., and Zeng, B. (2014, January 27–28). InFrame: Multiflexing full-frame visible communication channel for humans and devices. Proceedings of the 13th ACM Workshop on Hot Topics in Networks, Los Angeles, CA, USA.10.1145/2670518.2673867 ↗
22. Analysis of the effect of vignetting on MIMO optical wireless systems using spatial OFDM10.1109/JLT.2013.2294647 ↗
23. RIHOOP: Robust Invisible Hyperlinks in Offline and Online Photographs10.1109/TCYB.2020.3037208 ↗
24. SunBox: Screen-To-camera communication with ambient light10.1145/3534602 ↗
25. Tran, V., Jayatilaka, G., Ashok, A., and Misra, A. (2021, January 18). DeepLight: Robust & Unobtrusive Real-time Screen-Camera Communication for Real-World Displays. Proceedings of the 20th International Conference on Information Processing in Sensor Networks (Co-Located with CPS-IoT Week 2021), Nashville, TN, USA.10.1145/3412382.3458269 ↗
26. Qian, K., Lu, Y., Yang, Z., Zhang, K., Huang, K., Cai, X., Wu, C., and Liu, Y. (2021, January 12–14). {AIRCODE}: Hidden {Screen-Camera} Communication on an Invisible and Inaudible Dual Channel. Proceedings of the 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21), Online.
27. MobiScan: An enhanced invisible screen-camera communication system for IoT applications10.1002/ett.4151 ↗
28. DisCo: Display-camera communication using rolling shutter sensors10.1145/2896818 ↗
29. Hu, W., Gu, H., and Pu, Q. (October, January 30). LightSync: Unsynchronized visual communication over screen-camera links. Proceedings of the 19th Annual International Conference on Mobile Computing & Networking, Miami, FL, USA.
30. Chromacode: A fully imperceptible screen-camera communication system10.1109/TMC.2019.2956493 ↗
31. Yuan, W., Dana, K., Ashok, A., Gruteser, M., and Mandayam, N. (2012, January 9–11). Dynamic and invisible messaging for visual MIMO. Proceedings of the 2012 IEEE Workshop on the Applications of Computer Vision (WACV), Breckenridge, CO, USA.10.1109/WACV.2012.6162992 ↗
32. Comparison of different image enhancement techniques based upon PSNR & MSE
33. Analysis and compensation of rolling shutter effect10.1109/TIP.2008.925384 ↗
34. Rao, K.D. (2015). Channel Coding Techniques for Wireless Communications, Springer.
35. A reliable and unobtrusive approach to display area detection for imperceptible display camera communication10.1016/j.jvcir.2022.103510 ↗
36. Li, Z., Liu, F., Yang, W., Peng, S., and Zhou, J. (2021). A survey of convolutional neural networks: Analysis, applications, and prospects. IEEE Trans. Neural Netw. Learn. Syst., 1–21.
37. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
38. Tzutalin, D. (2015). LabelImg. Github Repos., 6.
39. Yu, C.W., Chen, Y.L., Lee, K.F., Chen, C.H., and Hsiao, C.Y. (2019, January 20–22). Efficient Intelligent Automatic Image Annotation Method based on Machine Learning Techniques. Proceedings of the 2019 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW), Yilan, Taiwan.10.1109/ICCE-TW46550.2019.8991727 ↗
40. Gedraite, E.S., and Hadad, M. (2011, January 14–16). Investigation on the effect of a Gaussian Blur in image filtering and segmentation. Proceedings of the ELMAR-2011, Zadar, Croatia.
41. Shi, J., and Tomasi, C. (1994, January 21–23). Good features to track. Proceedings of the 1994 IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.
42. Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.10.1017/CBO9780511811685 ↗