An Image Processing Protocol to Extract Variables Predictive of Human Embryo Fitness for Assisted Reproduction
Source abstract
Abstract
Despite the use of new techniques on embryo selection and the presence of equipment on the market, such as EmbryoScope® and Geri®, which help in the evaluation of embryo quality, there is still a subjectivity between the embryologist’s classifications, which are subjected to inter- and intra-observer variability, therefore compromising the successful implantation of the embryo. Nonetheless, with the acquisition of images through the time-lapse system, it is possible to perform digital processing of these images, providing a better analysis of the embryo, in addition to enabling the automatic analysis of a large volume of information. An image processing protocol was developed using well-established techniques to segment the image of blastocysts and extract variables of interest. A total of 33 variables were automatically generated by digital image processing, each one representing a different aspect of the embryo and describing a different characteristic of the blastocyst. These variables can be categorized into texture, gray-level average, gray-level standard deviation, modal value, relations, and light level. The automated and directed steps of the proposed processing protocol exclude spurious results, except when image quality (e.g., focus) prevents correct segmentation. The image processing protocol can segment human blastocyst images and automatically extract 33 variables that describe quantitative aspects of the blastocyst’s regions, with potential utility in embryo selection for assisted reproductive technology (ART).
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Reproductive Biology and Fertility · Ovarian function and disorders
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Laboratory of Applied Mathematics, Department of Biological Sciences, São Paulo State University (UNESP), Assis CEP 19806-900, Brazil
Graduate Program in Pharmacology and Biotechnology, Institute of Biosciences, São Paulo State University (UNESP), Botucatu CEP 18618-689, Brazil
Laboratory of Embryonic Micromanipulation, Department of Biological Sciences, São Paulo State University (UNESP), Assis CEP 13418-900, Brazil
IVF Laboratory, IVI Valencia, 46015 Valencia, Spain
Health Research Institute La Fe, 46026 Valencia, Spain
Funding
São Paulo Research Foundation
References (54)
Show source-provided references
1. AI in the treatment of fertility: Key considerations10.1007/s10815-020-01950-z ↗
2. Deep learning early warning system for embryo culture conditions and embryologist performance in the ART laboratory10.1007/s10815-021-02198-x ↗
3. Three ways of knowing: The integration of clinical expertise, evidence-based medicine, and artificial intelligence in assisted reproductive technologies10.1007/s10815-021-02159-4 ↗
4. Review of computer vision application in in vitro fertilization: The application of deep learning-based computer vision technology in the world of IVF10.1007/s10815-021-02123-2 ↗
5. Artificial intelligence in human in vitro fertilization and embryology10.1016/j.fertnstert.2020.09.157 ↗
6. A machine learning system with reinforcement capacity for predicting the fate of an ART embryo10.1080/19396368.2020.1822953 ↗
7. Mining of variables from embryo morphokinetics, blastocyst’s morphology and patient parameters: An approach to predict the live birth in the assisted reproduction service
8. Artificial intelligence in the IVF laboratory: Overview through the application of different types of algorithms for the classification of reproductive data10.1007/s10815-020-01881-9 ↗
9. Effect of morphokinetics and morphological dynamics of cleavage stage on embryo developmental potential: A time-lapse study10.1016/j.tjog.2017.12.013 ↗
10. An automated blastomere identification method for the evaluation of day 2 embryos during IVF/ICSI treatments10.1016/j.cmpb.2017.12.022 ↗
11. Patil, S.N., Wali, U.V., and Swamy, M.K. (2016, January 9–10). Application of vessel enhancement for automated classification of human in vitro-fertilized (IVF) images. Proceedings of the International Conference on Electrical, Electronics, Communication, Computer and Optimization Techniques (ICEECCOT), Mysuru, India.10.1109/ICEECCOT.2016.7955180 ↗
12. New approaches to embryo selection10.1016/j.rbmo.2013.05.013 ↗
13. Inter-observer and intra-observer agreement between embryologists during selection of a single Day 5 embryo for transfer: A multicenter study10.1093/humrep/dew330 ↗
14. Clinical implementation of algorithm-based embryo selection is associated with improved pregnancy outcomes in single vitrified warmed euploid embryo transfers10.1007/s10815-021-02203-3 ↗
15. Consistency and objectivity of automated embryo assessments using deep neural networks10.1016/j.fertnstert.2019.12.004 ↗
16. Gonzalez, R.C., and Woods, R.E. (2007). Digital Image Processing, Pearson. [3rd ed.].
17. Methods for assessing the quality of mammalian embryos: How far we are from the gold standard?10.5935/1518-0557.20160033 ↗
18. Jansen, R., and Mortimer, D. (1999). In Vitro culture of human blastocysts. Towards Reproductive Certainty: Fertility and Genetics Beyond, Parthenon Press.
19. Blastocyst classification systems used in Latin America: Is a consensus possible?
20. Morphological systems of human embryo assessment and clinical evidence10.1016/j.rbmo.2012.10.021 ↗
21. Automatized image processing of bovine blastocysts produced in vitro for quantitative variable determination10.1038/sdata.2017.192 ↗
22. Euploid embryos selected by an automated time-lapse system have superior SET outcomes than selected solely by conventional morphology assessment10.1007/s10815-018-1265-7 ↗
23. A method for semi-automatic grading of human blastocyst microscope images10.1093/humrep/des219 ↗
24. Automatic segmentation of trophectoderm in microscopic images of human blastocysts10.1109/TBME.2014.2356415 ↗
25. A method using artificial neural networks to morphologically assess mouse blastocyst quality10.1186/2055-0391-56-15 ↗
26. Focus on time-lapse analysis: Blastocyst collapse and morphometric assessment as new features of embryo viability10.1016/j.rbmo.2021.08.008 ↗
27. Time-lapse imaging of embryos: Current evidence supporting its use10.1080/17434440.2016.1230015 ↗
28. PNN-Based Classification of Retinal Diseases Using Fundus Image10.1016/B978-0-12-819361-7.00011-7 ↗
29. The MathWorks Inc. (2019). Image Processing ToolboxTM User’s Guide, The MathWorks.
30. Simões, A.S., Colombini, E.L., and Tonidandel, F. (2018). Aplicação do processamento de imagem digital para a detecção de câncer de mama. Anais da Mostra Nacional de Robótica, Proceedings of the Mostra Nacional de Robótica 2018, João Pessoa, Brazil, 6–10 November 2018, MNR. (In Portuguese).
31. A review paper on Hough transform and it’s applications in image processing
32. Hough Transform Implementation for Event-Based Systems: Concepts and Challenges10.3389/fncom.2018.00103 ↗
33. Hough, P.V. (1962). Method and Means for Recognizing Complex Patterns. (3,069,654), U.S. Patent.
34. Al-Ameen, Z. (2020, January 26–27). Contrast enhancement of medical images using statistical methods with image processing concepts. Proceedings of the 6th International Engineering Conference “Sustainable Technology and Development” (IEC), Erbil, Iraq.10.1109/IEC49899.2020.9122925 ↗
35. Gradient magnitude similarity deviation: A highly efficient perceptual image quality index10.1109/TIP.2013.2293423 ↗
36. Extremal Regions Detection Guided by Maxima of Gradient Magnitude10.1109/TIP.2015.2477215 ↗
37. Yang, L., Wu, X., Zhao, D., Li, H., and Zhai, J. (2011, January 15–17). An improved Prewitt algorithm for edge detection based on noised image. Proceedings of the 4th International Congress on Image and Signal Processing, Shanghai, China.10.1109/CISP.2011.6100495 ↗
38. Gonzalez, R.C., Woods, R.E., and Eddins, S.L. (2003). Digital Image Processing Using MATLAB, Prentice Hall. [3rd ed.].
39. Texture Characteristic of Local Binary Pattern on Face Recognition with Probabilistic Linear Discriminant Analysis
40. The MathWorks Inc. (2019). Computer Vision ToolboxTM User’s Guide, The MathWorks.
41. Chen, Q., Yang, X., and Petriu, E.M. (2004, January 2–3). Watershed segmentation for binary images with different distance transforms. Proceedings of the 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications, Ottawa, ON, Canada.
42. Unsupervised texture segmentation using Gabor filters10.1016/0031-3203(91)90143-S ↗
43. Texture classification and segmentation using wavelet packet frame and Gaussian mixture model10.1016/j.patcog.2006.09.012 ↗
44. The MathWorks Inc. (2020). Statistics and Machine Learning ToolboxTM User’s Guide, The MathWorks.
45. A method based on artificial intelligence to fully automatize the evaluation of bovine blastocyst images10.1038/s41598-017-08104-9 ↗
46. Nogueira, M.F.G., Guilherme, V.B., Pronunciate, M., Dos Santos, P.H., Da Silva, D.L.B., and Rocha, J.C. (2018). Artificial Intelligence-Based Grading Quality of Bovine Blastocyst Digital Images: Direct Capture with Juxtaposed Lenses of Smartphone Camera and Stereomicroscope Ocular Lens. Sensors, 18.10.3390/s18124440 ↗
47. Human Pre-gastrulation Development10.1016/bs.ctdb.2017.11.004 ↗
48. Is AI assessment of morphokinetic data and digital image analysis from time-lapse culture predictive of implantation potential of human embryos?10.1016/j.fertnstert.2018.07.1040 ↗
49. Application of artificial intelligence technology to increase the efficacy of embryo selection and prediction of live birth using human blastocysts cultured in a time-lapse incubator10.1016/j.fertnstert.2018.07.1039 ↗
50. First application of artificial neuronal networks for human live birth prediction on geri time-lapse monitoring system blastocyst images10.1016/j.fertnstert.2020.08.414 ↗
51. Van Den Heuvel, T.L.A., De Bruijn, D., De Korte, C.L., and Ginneken, B.V. (2018). Automated measurement of fetal head circumference using 2D ultrasound images. PLoS ONE, 13.10.1371/journal.pone.0200412 ↗
52. Huang, C.L., Lian, M.J., Wu, Y.H., Chen, W.M., and Chiu, W.T. (2020). Identification of human ovarian adeno-carcinoma cells with cisplatin-resistance by feature extraction of gray Level Co-occurrence matrix using optical images. Diagnostics, 10.10.3390/diagnostics10060389 ↗
53. Local binary patterns variants as texture descriptors for medical image analysis10.1016/j.artmed.2010.02.006 ↗
54. Association between blastocyst morphology and outcome of single-blastocyst transfer10.1016/j.rbmo.2013.07.006 ↗