journal article·2019-06-06Open access

Deep Learning and Big Data in Healthcare: A Double Review for Critical Beginners

Luis Bote-Curiel, Sergio Muñoz-Romero, Alicia Gerrero-Curieses, José Luis Rojo-Álvarez

Applied Sciences· Volume 9· Issue 11

Abstract

In the last few years, there has been a growing expectation created about the analysis of large amounts of data often available in organizations, which has been both scrutinized by the academic world and successfully exploited by industry. Nowadays, two of the most common terms heard in scientific circles are Big Data and Deep Learning. In this double review, we aim to shed some light on the current state of these different, yet somehow related branches of Data Science, in order to understand the current state and future evolution within the healthcare area. We start by giving a simple description of the technical elements of Big Data technologies, as well as an overview of the elements of Deep Learning techniques, according to their usual description in scientific literature. Then, we pay attention to the application fields that can be said to have delivered relevant real-world success stories, with emphasis on examples from large technology companies and financial institutions, among others. The academic effort that has been put into bringing these technologies to the healthcare sector are then summarized and analyzed from a twofold view as follows: first, the landscape of application examples is globally scrutinized according to the varying nature of medical data, including the data forms in electronic health recordings, medical time signals, and medical images; second, a specific application field is given special attention, in particular the electrocardiographic signal analysis, where a number of works have been published in the last two years. A set of toy application examples are provided with the publicly-available MIMIC dataset, aiming to help the beginners start with some principled, basic, and structured material and available code. Critical discussion is provided for current and forthcoming challenges on the use of both sets of techniques in our future healthcare.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Healthcare · Artificial Intelligence in Healthcare · COVID-19 diagnosis using AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Signal Theory and Communications, Rey Juan Carlos University, 28943 Fuenlabrada, Spain

Center for Computational Simulation, Universidad Politécnica de Madrid, 28223 Pozuelo de Alarcón, Spain

References (100+)

Show source-provided references
1. Kelleher, J.D., and Tierney, B. (2018). Data Science, MIT Press. [1st ed.].
2. Data-Driven Business Model Innovation10.1111/jpim.12398 ↗
3. Making Data Valuable: Political, Economic, and Conceptual Bases of Big Data10.1007/s13347-017-0295-x ↗
4. Press, G. (2019, January 19). 12 Big Data Definitions: What’s Yours?. Available online: https://www.forbes.com/sites/gilpress/2014/09/03/12-big-data-definitions-whats-yours/.
5. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, The MIT Press. [1st ed.].
6. Data Science and its Relationship to Big Data and Data-Driven Decision Making10.1089/big.2013.1508 ↗
7. Granville, V. (2019, January 19). Difference Between Machine Learning, Data Science, AI, Deep Learning, and Statistics. Available online: https://www.datasciencecentral.com/profiles/blogs/difference-between-machine-learning-data-science-ai-deep-learning.
8. Franks, B. (2014). Understanding Operational Analytics. The Analytics Revolution, John Wiley & Sons, Ltd.10.1002/9781118936672.ch1 ↗
9. From Databases to Big Data10.1109/MIC.2012.50 ↗
10. Dutcher, J. (2019, January 19). What is Big Data?. Available online: https://datascience.berkeley.edu/what-is-big-data/.
11. Beyer, M.A., and Laney, D. (2019, January 19). The Importance of ’Big Data’: A Definition. Available online: https://https://www.gartner.com/doc/2057415/importance-big-data-definition.
12. Laney, D. (2019, January 19). 3D Data Management: Controlling Data Volume, Velocity, and Variety. Available online: http://blogs.gartner.com/doug-laney/files/2012/01/ad949-3D-Data-Management-Controlling-Data-Volume-Velocity-and-Variety.pdf.
13. Loshin, D. (2013). Big Data Analytics: From Strategic Planning to Enterprise Integration with Tools, Techniques, NoSQL, and Graph, Morgan Kaufmann Publishers Inc.. [1st ed.].
14. Critical Analysis of Big Data Challenges and Analytical Methods10.1016/j.jbusres.2016.08.001 ↗
15. Big Data: State of the Art Concepts, Techniques, Technologies, Modeling Approaches and Research Challenges
16. Chandarana, P., and Vijayalakshmi, M. (2014, January 4–5). Big Data Analytics Frameworks. Proceedings of the 2014 International Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA), Mumbai, India.10.1109/CSCITA.2014.6839299 ↗
17. Beyond the Hype: Big Data Concepts, Methods, and Analytics10.1016/j.ijinfomgt.2014.10.007 ↗
18. Krishnan, K. (2013). Data Warehousing in the Age of Big Data, Morgan Kaufmann. [1st ed.].
19. Deep Learning and Its Applications in Biomedicine10.1016/j.gpb.2017.07.003 ↗
20. Deep Learning in Radiology10.1016/j.acra.2018.02.018 ↗
21. Opportunities and Obstacles for Deep Learning in Biology and Medicine10.1098/rsif.2017.0387 ↗
22. Deep Learning on 1-D Biosignals: A Taxonomy-based Survey10.1055/s-0038-1667083 ↗
23. Big Data: A Survey10.1007/s11036-013-0489-0 ↗
24. Xiaomeng, S. (2019, January 19). Introduction to Big Data. Available online: https://www.ntnu.no/iie/fag/big/lessons/lesson2.pdf.
25. Marz, N., and Warren, J. (2015). Big Data: Principles and Best Practices of Scalable Realtime Data Systems, Manning Publications Co.. [1st ed.].
26. Data-Intensive Applications, Challenges, Techniques and Technologies: A Survey on Big Data10.1016/j.ins.2014.01.015 ↗
27. Using In-Memory Analytics to Quickly Crunch Big Data10.1109/MC.2012.358 ↗
28. Kimball, R., and Ross, M. (2013). The Data Warehouse Toolkit: The Definitive Guide to Dimensional Modeling, John Wiley & Sons, Ltd.. [3rd ed.].
29. NIST Big Data Public Working Group (2019, January 19). NIST Big Data Interoperability Framework: Volume 6, Reference Architecture, Available online: https://bigdatawg.nist.gov/_uploadfiles/NIST.SP.1500-6r1.pdf.
30. Apache Software Foundation (2019, January 19). Welcome to Apache Hadoop!. Available online: https://hadoop.apache.org.
31. Bakshi, K. (2012, January 3–10). Considerations for Big Data: Architecture and Approach. Proceedings of the 2012 IEEE Aerospace Conference, Big Sky, MT, USA.10.1109/AERO.2012.6187357 ↗
32. Chalmers, S.J., Bothorel, C., and Clemente, R. (2019, January 19). Big Data-State of the Art. Available online: https://hal.archives-ouvertes.fr/hal-00903966.
33. Apache Software Foundation (2019, January 19). Apache Mahout: Scalable Machine Learning and Data Mining. Available online: https://mahout.apache.org.
34. Apache Software Foundation (2019, January 19). Apache Spark. Available online: https://spark.apache.org.
35. Paradigm4 (2019, January 19). SciDB—The Array Database Management System. Available online: https://www.paradigm4.com/technology/Open_Source.
36. Architects Zone (2019, January 19). Performance of Graph vs. Relational Databases. Available online: http://architects.dzone.com/articles/performance-graph-vs.
37. Malewicz, G., Austern, M.H., Bik, A.J., Dehnert, J.C., Horn, I., Leiser, N., and Czajkowski, G. (2010, January 6–10). Pregel: A System for Large-scale Graph Processing. Proceedings of the 2010 ACM SIGMOD International Conference on Management of Data, Athens, Greece.10.1145/1807167.1807184 ↗
38. Apache Software Foundation (2019, January 19). Giraph—Welcome To Apache Giraph!. Available online: http://giraph.apache.org.
39. Apache Software Foundation (2019, January 19). Hama—The Apache Software Foundation!. Available online: http://hama.apache.org.
40. A Bridging Model for Parallel Computation10.1145/79173.79181 ↗
41. Bisseling, R.H. (2004). Parallel Scientific Computation: A Structured Approach Using BSP and MPI, Oxford University Press. [1st ed.].
42. MLPACK: A Scalable C++ Machine Learning Library
43. Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud10.14778/2212351.2212354 ↗
44. Pentaho and Jaspersoft: A Comparative Study of Business Intelligence Open Source Tools Processing Big Data to Evaluate Performances
45. NewGenApps (2019, January 19). R vs. Python for Data Sciences and Statistics—The Ultimate Comparison. Available online: https://www.newgenapps.com/blog/r-vs-python-for-data-science-big-data-artificial-intelligence-ml.
46. Subramanian, V. (2018). Deep Learning with PyTorch, Packt Publishing. [1st ed.].
47. Chollet, F. (2017). Deep Learning with Python, Manning Publications. [1st ed.].
48. Deep learning for healthcare: Review, opportunities and challenges10.1093/bib/bbx044 ↗
49. Artificial Intelligence in Precision Cardiovascular Medicine10.1016/j.jacc.2017.03.571 ↗
50. Deep Learning for Healthcare Applications Based on Physiological Signals: A Review10.1016/j.cmpb.2018.04.005 ↗
51. Artificial intelligence in healthcare: Past, present and future10.1136/svn-2017-000101 ↗
52. Deep Learning beyond Cats and Dogs: Recent Advances in Diagnosing Breast Cancer with Deep Neural Networks10.1259/bjr.20170545 ↗
53. Evolution, Current Challenges, and Future Possibilities in ECG Biometrics10.1109/ACCESS.2018.2849870 ↗
54. Frankle, J., and Carbin, M. (2019). The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks. arXiv.
55. Kim, B., Wattenberg, M., Gilmer, J., Cai, C., Wexler, J., Viegas, F., and Sayres, R. (2018, January 10–15). Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV). Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
56. Deep Learning in Neural Networks: An Overview10.1016/j.neunet.2014.09.003 ↗
57. A Fast Learning Algorithm for Deep Belief Nets10.1162/neco.2006.18.7.1527 ↗
58. Bengio, Y., Lamblin, P., Popovici, D., and Larochelle, H. (2006, January 4–7). Greedy Layer-wise Training of Deep Networks. Proceedings of the 19th International Conference on Neural Information Processing Systems, Cambridge, MA, USA.10.7551/mitpress/7503.003.0024 ↗
59. Backpropagation Applied to Handwritten Zip Code Recognition10.1162/neco.1989.1.4.541 ↗
60. Gutiérrez, L., and Keith, B. (2018). A Systematic Literature Review on Word Embeddings. International Conference on Software Process Improvement, Springer.
61. Russac, Y., Caelen, O., and He-Guelton, L. (2018). Embeddings of Categorical Variables for Sequential Data in Fraud Context. The International Conference on Advanced Machine Learning Technologies and Applications, Springer.10.1007/978-3-319-74690-6_53 ↗
62. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J. (2013, January 5–10). Distributed Representations of Words and Phrases and their Compositionality. Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe, NA, USA.
63. Pennington, J., Socher, R., and Manning, C.D. (2014, January 25–29). GloVe: Global Vectors for Word Representation. Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1162 ↗
64. Li, H., Kadav, A., Durdanovic, I., Samet, H., and Graf, H.P. (2017, January 24–26). Pruning Filters for Efficient ConvNets. Proceedings of the International Conference on Learning Representations, Toulon, France.
65. Big Data: Deep Learning for Financial Sentiment Analysis10.1186/s40537-017-0111-6 ↗
66. (2019, January 24). Google Brain Team. Available online: https://ai.google/research/teams/brain.
67. Dang, L.M., Hassan, S.I., Im, S., Lee, J., Lee, S., and Moon, H. (2018). Deep Learning Based Computer Generated Face Identification Using Convolutional Neural Network. Appl. Sci., 8.10.3390/app8122610 ↗
68. Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7–12). FaceNet: A Unified Embedding for Face Recognition and Clustering. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298682 ↗
69. Taigman, Y., Yang, M., Ranzato, M., and Wolf, L. (2014, January 23–28). DeepFace: Closing the Gap to Human-Level Performance in Face Verification. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.220 ↗
70. Human Activity Recognition with Smartphone Sensors Using Deep Learning Neural Networks10.1016/j.eswa.2016.04.032 ↗
71. Kitsikidis, A., Dimitropoulos, K., Douka, S., and Grammalidis, N. (2014, January 11–14). Dance Analysis Using Multiple Kinect Sensors. Proceedings of the 2014 International Conference on Computer Vision Theory and Applications, Berlin, Germany.
72. Application of Deep Learning for Object Detection10.1016/j.procs.2018.05.144 ↗
73. Nguyen, A., Yosinski, J., and Clune, J. (2015, January 7–12). Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298640 ↗
74. Su, J., Vargas, D.V., and Sakurai, K. (2019). One Pixel Attack for Fooling Deep Neural Networks. IEEE Trans. Evolut. Comput.10.1109/TEVC.2019.2890858 ↗
75. A Generative Vision Model that Trains with High Data Efficiency and Breaks Text-Based CAPTCHAs10.1126/science.aag2612 ↗
76. Kannan, A., Kurach, K., Ravi, S., Kaufmann, T., Tomkins, A., Miklos, B., Corrado, G., Lukacs, L., Ganea, M., and Young, P. (2016, January 13–17). Smart Reply: Automated Response Suggestion for Email. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939801 ↗
77. Jumping NLP Curves: A Review of Natural Language Processing Research10.1109/MCI.2014.2307227 ↗
78. Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation10.1162/tacl_a_00065 ↗
79. Skype Translator: Breaking Down Language and Hearing Barriers
80. Alexa, Siri, Cortana, and More: An Introduction to Voice Assistants10.1080/02763869.2018.1404391 ↗
81. (2019, January 24). Facebook AI Research. Available online: https://research.fb.com/category/facebook-ai-research/.
82. (2019, January 24). Twitter Cortex. Available online: https://cortex.twitter.com/en.html.
83. Lázaro-Gredilla, M., Lin, D., Guntupalli, J.S., and George, D. (2019). Beyond imitation: Zero-shot task transfer on robots by learning concepts as cognitive programs. arXiv, 4.10.1126/scirobotics.aav3150 ↗
84. Bean, R. (2019, January 24). How American Express Excels As a Data-Driven Culture. Available online: https://www.forbes.com/sites/ciocentral/2018/03/15/how-american-express-excels-as-a-data-driven-culture.
85. Sirignano, J., Sadhwani, A.K., and Giesecke, K. (2016). Deep Learning for Mortgage Risk. arXiv.
86. Roy, A., Sun, J., Mahoney, R., Alonzi, L., Adams, S., and Beling, P. (2018, January 27). Deep Learning Detecting Fraud in Credit Card Transactions. Proceedings of the 2018 Systems and Information Engineering Design Symposium, Charlottesville, VA, USA.10.1109/SIEDS.2018.8374722 ↗
87. Gudelek, M.U., Boluk, S.A., and Ozbayoglu, A.M. (December, January 27). A Deep Learning Based Stock Trading Model with 2-D CNN Trend Detection. Proceedings of the 2017 IEEE Symposium Series on Computational Intelligence, Hawaii, HI, USA.10.1109/SSCI.2017.8285188 ↗
88. Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources10.1109/MGRS.2017.2762307 ↗
89. Deep learning in Agriculture: A Survey10.1016/j.compag.2018.02.016 ↗
90. Deep Neural Networks Based Recognition of Plant Diseases by Leaf Image Classification10.1155/2016/3289801 ↗
91. Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., and McCool, C. (2016). DeepFruits: A Fruit Detection System Using Deep Neural Networks. Sensors, 16.10.3390/s16081222 ↗
92. Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data10.1109/LGRS.2017.2681128 ↗
93. Briggs, B. (2019, January 24). BP has a New AI Tool for Drilling into Data—and it’s Fueling Smarter Decisions. Available online: https://news.microsoft.com/transform/bp-ai-drilling-data-fueling-smarter-decisions/.
94. Deep Learning and Process Understanding for Data-Driven Earth System Science10.1038/s41586-019-0912-1 ↗
95. Borgi, T., Zoghlami, N., and Abed, M. (2017, January 14–17). Big Data for Transport and Logistics: A Review. Proceedings of the 2017 International Conference on Advanced Systems and Electric Technologies, Hammamet, Tunisia.10.1109/ASET.2017.7983742 ↗
96. Ma, X., Yu, H., Wang, Y., and Wang, Y. (2015). Large-Scale Transportation Network Congestion Evolution Prediction Using Deep Learning Theory. PLoS ONE, 10.10.1371/journal.pone.0119044 ↗
97. Sameen, M.I., and Pradhan, B. (2017). Severity Prediction of Traffic Accidents with Recurrent Neural Networks. Appl. Sci., 7.10.3390/app7060476 ↗
98. Multi-column Deep Neural Network for Traffic Sign Classification10.1016/j.neunet.2012.02.023 ↗
99. Ackerman, E., and Pagano, A. (2019, January 19). Deep-Learning First: Drive.ai’s Path to Autonomous Driving. Available online: https://spectrum.ieee.org/video/transportation/self-driving/driveai-deep-learning-first-autonomous-driving.
100. Sinha, N. (2019, January 19). Deep Learning for E-Commerce Search. Available online: https://medium.com/@ekshakhs/has-deep-learning-solved-search-yet-fb6490abfd1.