journal article·2025-04-30Open access

Cognitive Electronic Unit for AI-Guided Real-Time Echocardiographic Imaging

Emanuele De Luca, Emanuele Amato, Vincenzo Valente, Marianna La Rocca, Tommaso Maggipinto, Roberto Bellotti, Francesco Dell’Olio

Applied Sciences· Volume 15· Issue 9

Abstract

Echocardiography is a fundamental tool in cardiovascular diagnostics, providing radiation-free real-time assessments of cardiac function. However, its accuracy strongly depends on operator expertise, resulting in inter-operator variability that affects diagnostic consistency. Recent advances in artificial intelligence have enabled new applications for real-time image classification and probe guidance, but these typically rely on large datasets and specialized hardware such as GPU-based or embedded accelerators, limiting their clinical adoption. Here, we address this challenge by developing a cognitive electronic unit that integrates convolutional neural network (CNN) models and an inertial sensor for assisted echocardiography. We show that our system—powered by an NVIDIA Jetson Orin Nano—can effectively classify standard cardiac views and differentiate good-quality from poor-quality ultrasound images in real time even when trained on relatively small datasets. Preliminary results indicate that the combined use of CNN-based classification and inertial sensor-based feedback can reduce inter-operator variability and may also enhance diagnostic precision. By lowering barriers to data acquisition and providing real-time guidance, this system has the potential to benefit both novice and experienced sonographers, helping to standardize echocardiographic exams and improve patient outcomes. Further data collection and model refinements are ongoing, progressing the way for a more robust and widely applicable clinical solution.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Engineering Education and Technology · Reservoir Engineering and Simulation Methods · Economic and Technological Developments in Russia

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Micro Nano Sensor Group, Politecnico di Bari, 70125 Bari, Italy

Dipartimento Interateneo di Fisica, Università degli Studi di Bari Aldo Moro, 70125 Bari, Italy

Istituto Nazionale di Fisica Nucleare (INFN), Sezione di Bari, 70125 Bari, Italy

Predict S.p.A., 70125 Bari, Italy

References (29)

Show source-provided references
1. Robotic Ultrasound Imaging: State-of-the-art and Future Perspectives10.1016/j.media.2023.102878 ↗
2. Tenajas, R., Miraut, D., Illana, C.I., Alonso-Gonzalez, R., Arias-Valcayo, F., and Herraiz, J.L. (2023). Recent Advances in Artificial Intelligence-Assisted Ultrasound Scanning. Appl. Sci., 13.10.3390/app13063693 ↗
3. Mathiassen, K., Fjellin, J.E., Glette, K., Hol, P.K., and Elle, O.J. (2016). An Ultrasound Robotic System Using the Commercial Robot UR5. Front. Robot. AI, 3.10.3389/frobt.2016.00001 ↗
4. Mathur, B., Topiwala, A., Schaffer, S., Kam, M., Saeidi, H., Fleiter, T., and Krieger, A. (2019, January 28–30). A Semi-Autonomous Robotic System for Remote Trauma Assessment. Proceedings of the 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE), Athens, Greece.10.1109/BIBE.2019.00122 ↗
5. Robotic Arm Based Automatic Ultrasound Scanning for Three-Dimensional Imaging10.1109/TII.2018.2871864 ↗
6. Utility of a Deep-Learning Algorithm to Guide Novices to Acquire Echocardiograms for Limited Diagnostic Use10.1001/jamacardio.2021.0185 ↗
7. Ferraz, S., Coimbra, M., and Pedrosa, J. (2023). Assisted Probe Guidance in Cardiac Ultrasound: A Review. Front. Cardiovasc. Med., 10.10.3389/fcvm.2023.1056055 ↗
8. Chen, C., Qin, C., Qiu, H., Tarroni, G., Duan, J., Bai, W., and Rueckert, D. (2020). Deep Learning for Cardiac Image Segmentation: A Review. Front. Cardiovasc. Med., 7.10.3389/fcvm.2020.00025 ↗
9. Artificial Intelligence and Echocardiography10.1530/ERP-18-0056 ↗
10. Artificial Intelligence in Echocardiography: Detection, Functional Evaluation, and Disease Diagnosis10.1186/s12947-021-00261-2 ↗
11. Kusunose, K., Haga, A., Inoue, M., Fukuda, D., Yamada, H., and Sata, M. (2020). Clinically Feasible and Accurate View Classification of Echocardiographic Images Using Deep Learning. Biomolecules, 10.10.3390/biom10050665 ↗
12. Fast and Accurate View Classification of Echocardiograms Using Deep Learning10.1038/s41746-017-0013-1 ↗
13. Assisted Probe Positioning for Ultrasound Guided Radiotherapy Using Image Sequence Classification
14. Improving Ultrasound Video Classification: An Evaluation of Novel Deep Learning Methods in Echocardiography10.21037/jmai.2019.10.03 ↗
15. Echocardiography View Classification Using Quality Transfer Star Generative Adversarial Networks
16. Deep Echocardiography: Data-Efficient Supervised and Semi-Supervised Deep Learning towards Automated Diagnosis of Cardiac Disease10.1038/s41746-018-0065-x ↗
17. Wegner, F., Benesch Vidal, M., Niehues, P., Willy, K., Radke, R., Garthe, P., Eckardt, L., Baumgartner, H., Diller, G.P., and Orwat, S. (2022). Accuracy of Deep Learning Echocardiographic View Classification in Patients with Congenital or Structural Heart Disease: Importance of Specific Datasets. J. Clin. Med., 11.10.3390/jcm11030690 ↗
18. Akkus, Z., Aly, Y.H., Attia, I.Z., Lopez-Jimenez, F., Arruda-Olson, A.M., Pellikka, P.A., Pislaru, S.V., Kane, G.C., Friedman, P.A., and Oh, J.K. (2021). Artificial Intelligence (AI)-Empowered Echocardiography Interpretation: A State-of-the-Art Review. J. Clin. Med., 10.10.3390/jcm10071391 ↗
19. Handwriting Trajectory Reconstruction Using Low-Cost IMU
20. Arbitrary Spatial Trajectory Reconstruction Based on a Single Inertial Sensor10.1109/JSEN.2023.3257867 ↗
21. Suvorova, S., Vaithianathan, T., and Caelli, T. (2012, January 2–5). Action Trajectory Reconstruction from Inertial Sensor Measurements. Proceedings of the 2012 11th International Conference on Information Science, Signal Processing and Their Applications (ISSPA), Montreal, QC, Canada.10.1109/ISSPA.2012.6310700 ↗
22. Baller, S.P., Jindal, A., Chadha, M., and Gerndt, M. (2021, January 4–8). DeepEdgeBench: Benchmarking Deep Neural Networks on Edge Devices. Proceedings of the 2021 IEEE International Conference on Cloud Engineering (IC2E), San Francisco, CA, USA.10.1109/IC2E52221.2021.00016 ↗
23. Jo, J., Jeong, S., and Kang, P. (2020, January 19–22). Benchmarking GPU-Accelerated Edge Devices. Proceedings of the 2020 IEEE International Conference on Big Data and Smart Computing (BigComp), Busan, Republic of Korea.10.1109/BigComp48618.2020.00-89 ↗
24. Benchmarking Jetson Edge Devices with an End-to-End Video-Based Anomaly Detection System10.1007/978-3-031-53963-3_25 ↗
25. Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography10.1109/TMI.2019.2900516 ↗
26. Agarap, A.F. (2018). Deep Learning Using Rectified Linear Units (ReLU). arXiv.
27. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
28. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv.
29. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗