journal article·2021-07-16Open access

Instance Segmentation of Microscopic Foraminifera

Thomas Haugland Johansen, Steffen Aagaard Sørensen, Kajsa Møllersen, Fred Godtliebsen

Applied Sciences· Volume 11· Issue 14

Abstract

Foraminifera are single-celled marine organisms that construct shells that remain as fossils in the marine sediments. Classifying and counting these fossils are important in paleo-oceanographic and -climatological research. However, the identification and counting process has been performed manually since the 1800s and is laborious and time-consuming. In this work, we present a deep learning-based instance segmentation model for classifying, detecting, and segmenting microscopic foraminifera. Our model is based on the Mask R-CNN architecture, using model weight parameters that have learned on the COCO detection dataset. We use a fine-tuning approach to adapt the parameters on a novel object detection dataset of more than 7000 microscopic foraminifera and sediment grains. The model achieves a (COCO-style) average precision of 0.78 on the classification and detection task, and 0.80 on the segmentation task. When the model is evaluated without challenging sediment grain images, the average precision for both tasks increases to 0.84 and 0.86, respectively. Prediction results are analyzed both quantitatively and qualitatively and discussed. Based on our findings we propose several directions for future work and conclude that our proposed model is an important step towards automating the identification and counting of microscopic foraminifera.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Geology and Paleoclimatology Research · Methane Hydrates and Related Phenomena · Hydrocarbon exploration and reservoir analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mathematics and Statistics, UiT The Arctic University of Norway, 9019 Tromsø, Norway

Department of Geosciences, UiT The Arctic University of Norway, 9019 Tromsø, Norway

Department of Community Medicine, UiT The Arctic University of Norway, 9019 Tromsø, Norway

Funding

Tromsø Forskningsstiftelse · Vår Energi AS

References (38)

Show source-provided references
1. Hayward, B.W., Le Coze, F., Vachard, D., and Gross, O. (2021, April 29). World Foraminifera Database. Available online: http://www.marinespecies.org/foraminifera.
2. Recent calcium carbonate dissolution in the Barents Sea: Paleoceanographic applications10.1016/0025-3227(94)90022-1 ↗
3. Quantifying carbonate dissolution and calibration of foraminiferal dissolution indices in the Somali Basin10.1016/S0025-3227(01)00238-9 ↗
4. Benthonic foraminiferal distributions and quantitative transfer functions for the northwest European continental margin10.1016/j.marmicro.2004.05.009 ↗
5. Variations in temperature and extent of Atlantic Water in the northern North Atlantic during the Holocene10.1016/j.quascirev.2007.10.005 ↗
6. Water mass exchange between the Nordic seas and the Arctic Ocean on millennial timescale during MIS 4–MIS 210.1002/2013GC005020 ↗
7. Traditional and emerging geochemical proxies in foraminifera10.2113/gsjfr.40.2.165 ↗
8. Suokhrie, T., Saraswat, R., Nigam, R., Kathal, P., and Talib, A. (2017). Foraminifera as bio-indicators of pollution: A review of research over the last decade. Micropaleontology and Its Applications, Scientific Publishers.
9. Role of Foraminifera in Hydrocarbon Exploration
10. Zhong, B., Ge, Q., Kanakiya, B., Marchitto, R.M.T., and Lobaton, E. (December, January 27). A comparative study of image classification algorithms for Foraminifera identification. Proceedings of the 2017 IEEE Symposium Series on Computational Intelligence (SSCI), Honolulu, HI, USA.10.1109/SSCI.2017.8285164 ↗
11. Ge, Q., Zhong, B., Kanakiya, B., Mitra, R., Marchitto, T., and Lobaton, E. (December, January 27). Coarse-to-fine foraminifera image segmentation through 3D and deep features. Proceedings of the 2017 IEEE Symposium Series on Computational Intelligence (SSCI), Honolulu, HI, USA.10.1109/SSCI.2017.8280982 ↗
12. De Garidel-Thoron, T., Marchant, R., Soto, E., Gally, Y., Beaufort, L., Bolton, C.T., Bouslama, M., Licari, L., Mazur, J.C., and Brutti, J.M. (2017, January 11–15). Automatic Picking of Foraminifera: Design of the Foraminifera Image Recognition and Sorting Tool (FIRST) Prototype and Results of the Image Classification Scheme. Proceedings of the AGU Fall Meeting Abstracts, New Orleans, LA, USA.
13. Automated species-level identification of planktic foraminifera using convolutional neural networks, with comparison to human performance10.1016/j.marmicro.2019.01.005 ↗
14. Johansen, T.H., and Sørensen, S.A. (2020, January 20–21). Towards detection and classification of microscopic foraminifera using transfer learning. Proceedings of the Northern Lights Deep Learning Workshop, Tromsø, Norway.10.7557/18.5144 ↗
16. Dutta, A., Gupta, A., and Zissermann, A. (2020, March 10). VGG Image Annotator (VIA). Version: 2.0.9. Available online: http://www.robots.ox.ac.uk/~vgg/software/via/.
17. Dutta, A., and Zisserman, A. (2019, January 21–25). The VIA Annotation Software for Images, Audio and Video. Proceedings of the 27th ACM International Conference on Multimedia, MM’19, Nice, France.10.1145/3343031.3350535 ↗
18. Girshick, R. (2015, January 7–13). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.169 ↗
19. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
20. Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18–22). Path Aggregation Network for Instance Segmentation. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00913 ↗
21. Chen, X., Girshick, R., He, K., and Dollar, P. (November, January 27). TensorMask: A Foundation for Dense Object Segmentation. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00215 ↗
22. Wang, Y., Xu, Z., Shen, H., Cheng, B., and Yang, L. (2020, January 14–19). CenterMask: Single shot instance segmentation with point representation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Virtual.10.1109/CVPR42600.2020.00933 ↗
23. SOLOv2: Dynamic and Fast Instance Segmentation
24. He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7–12). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2016.90 ↗
25. Lin, T.Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
26. Lin, T.Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., and Dollár, P. (2021, May 02). Microsoft COCO: Common Objects in Context. Available online: https://arxiv.org/abs/1405.0312.
27. PyTorch: An Imperative Style, High-Performance Deep Learning Library
28. On the importance of initialization and momentum in deep learning
29. Kingma, D.P., and Ba, J. (2021, April 14). Adam: A Method for Stochastic Optimization. International Conference on Learning Representations. Available online: https://arxiv.org/abs/1412.6980.
30. Loshchilov, I., and Hutter, F. (2021, April 14). Decoupled Weight Decay Regularization. International Conference on Learning Representations. Available online: https://arxiv.org/abs/1711.05101.
31. (2021, April 17). COCO: Common Object in Context—Detection Evaluation. Available online: https://cocodataset.org/#detection-eval.
32. The Intriguing Relationship between Coiling Direction and Reproductive Mode in Benthic Foraminifera10.1177/0971102319890106 ↗
33. The correspondence between water temperature and coiling direction in Bulimina10.1029/PA005i003p00289 ↗
34. Miller, D., Nicholson, L., Dayoub, F., and Sünderhauf, N. (2018, January 21–26). Dropout Sampling for Robust Object Detection in Open-Set Conditions. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.10.1109/ICRA.2018.8460700 ↗
35. Miller, D., Dayoub, F., Milford, M., and Sünderhauf, N. (2019, January 20–24). Evaluating Merging Strategies for Sampling-based Uncertainty Techniques in Object Detection. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8793821 ↗
36. Morrison, D., Milan, A., and Antonakos, N. (2019, January 16–20). Uncertainty-aware Instance Segmentation using Dropout Sampling. Proceedings of the Robotic Vision Probabilistic Object Detection Challenge (CVPR 2019 Workshop), Long Beach, CA, USA.
37. Gal, Y., and Ghahramani, Z. (2016, January 19–24). Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. In Proceeding of the 33rd International Conference on Machine Learning, New York, NY, USA.
38. Teye, M., Azizpour, H., and Smith, K. (2018, January 10–15). Bayesian Uncertainty Estimation for Batch Normalized Deep Networks. Proceedings of the Machine Learning Research, Stockholm, Sweden.