U-Net based particle localization in granular experiments: accuracy limits and optimization
Source abstract
Abstract
Identifying the positions of granular particles from experimental images is often complicated by their partial overlap in two dimensional projections. Uneven backgrounds and inhomogeneous illuminations can add to the challenge. Conventional image-processing methods are often unable to analyze such images. We show that a deep neural network with an U-Net architecture can provide precise particle positions with a high detection rate. For our challenging test image the network correctly identifies 97.7\% of the particles while only creating 2.7 \% of false positives. The training of the U-Net requires a number of target images where the position of all particles have been identified by humans. Those positions are then indicated in the target images by setting a small number of mask pixels to white in an otherwise black image. We demonstrate that the design of these masks critically determines performance: mask size controls the resolution of overlapping particles, anti-aliased masks enable subpixel accuracy, and systematic human labeling biases set a measurable lower bound on achievable precision. Our final network achieves an accuracy of the particle coordinate of 3.7\% of the particle diameter.
Source: openaire · Quality: candidate unverified · Source record ↗
References (44)
Show source-provided references
1. Falcon, E., Wunenburger, R., Évesque, P., Fauve, S., Chabot, C., Garrabos, Y., Beysens, D.: Cluster formation in a granular medium fluidized by vibrations in low gravity. Phys. Rev. Lett. 83, 440–443 (1999). https://doi.org/10.1103/PhysRevLett.83.44010.1103/PhysRevLett.83.440 ↗
2. Sack, A., Heckel, M., Kollmer, J.E., Zimber, F., Pöschel, T.: Energy dissipation in driven granular matter in the absence of gravity. Phys. Rev. Lett. 111, 018001 (2013). https://doi.org/10.1103/PhysRevLett.111.01800110.1103/PhysRevLett.111.018001 ↗
3. Falcon, E., Bacri, J.-C., Laroche, C.: Equation of state of a granular gas homogeneously driven by particle rotations. Europhys. Lett. 103, 64004 (2013). https://doi.org/10.1209/0295-5075/103/6400410.1209/0295-5075/103/64004 ↗
4. Harth, K., Trittel, T., Wegner, S., Stannarius, R.: Free cooling of a granular gas of rodlike particles in microgravity. Phys. Rev. Lett. 120, 214301 (2018). https://doi.org/10.1103/PhysRevLett.120.21430110.1103/PhysRevLett.120.214301 ↗
5. Yu, P., Schröter, M., Sperl, M.: Velocity distribution of a homogeneously cooling granular gas. Phys. Rev. Lett. 124, 208007 (2020). https://doi.org/10.1103/PhysRevLett.124.20800710.1103/PhysRevLett.124.208007 ↗
6. Schneider, N., Musiolik, G., Kollmer, J.E., Steinpilz, T., Kruss, M., Jungmann, F., Demirci, T., Teiser, J., Wurm, G.: Experimental study of clusters in dense granular gas and implications for the particle stopping time in protoplanetary disks. Icarus 360, 114307 (2021). https://doi.org/10.1016/j.icarus.2021.11430710.1016/j.icarus.2021.114307 ↗
7. Pitikaris, S., Bartz, P., Yu, P., Cristoforetti, S., Sperl, M.: Granular cooling of ellipsoidal particles in microgravity. npj Microgravity 8(1), 11 (2022). https://doi.org/10.1038/s41526-022-00196-610.1038/s41526-022-00196-6 ↗
8. Puzyrev, D., Trittel, T., Harth, K., Stannarius, R.: Cooling of a granular gas mixture in microgravity. npj Microgravity 10, 36 (2024). https://doi.org/10.1038/s41526-024-00369-510.1038/s41526-024-00369-5 ↗
9. Cheng, K., Hou, M., Sun, W., Qiao, Z., Li, X., Lai, C., Yuan, J., Li, T., Ye, F., Chen, K., Yang, M.: Unraveling the role of gravity in shaping intruder dynamics within vibrated granular media. Commun. Phys. 7, 425 (2024). https://doi.org/10.1038/s42005-024-01927-910.1038/s42005-024-01927-9 ↗
10. Cheng, Z., Wang, J.: A particle-tracking method for experimental investigation of kinematics of sand particles under triaxial compression. Powder Technol. 328, 436–451 (2018). https://doi.org/10.1016/j.powtec.2017.12.07110.1016/j.powtec.2017.12.071 ↗
11. Cheng, Z., Zhou, B., Wang, J.: Tracking particles in sands based on particle shape parameters. Adv. Powder Technol. 31, 2005–2019 (2020). https://doi.org/10.1016/j.apt.2020.02.03310.1016/j.apt.2020.02.033 ↗
12. Cheng, Z., Wang, J.: An investigation of the breakage behaviour of a pre-crushed carbonate sand under shear using X-ray micro-tomography. Eng. Geol. 293, 106286 (2021). https://doi.org/10.1016/j.enggeo.2021.10628610.1016/j.enggeo.2021.106286 ↗
13. Yu, P., Stärk, E., Blochberger, G., Kaplik, M., Offermann, M., Tran, D., Adachi, M., Sperl, M.: Magnetically excited granular matter in low gravity. Rev. Sci. Instrum. 90(5), 054501 (2019). https://doi.org/10.1063/1.508531910.1063/1.5085319 ↗
14. Puzyrev, D., Harth, K., Trittel, T., Stannarius, R.: Machine learning for 3d particle tracking in granular gases. Microgravity Sci. Technol. 32, 897–906 (2020). https://doi.org/10.1007/s12217-020-09800-410.1007/s12217-020-09800-4 ↗
15. Newby, J.M., Schaefer, A.M., Lee, P.T., Forest, M.G., Lai, S.K.: Convolutional neural networks automate detection for tracking of submicron-scale particles in 2d and 3D. Proc. Natl. Acad. Sci. 115, 9026–9031 (2018). https://doi.org/10.1073/pnas.180442011510.1073/pnas.1804420115 ↗
16. Midtvedt, B., Helgadottir, S., Argun, A., Pineda, J., Midtvedt, D., Volpe, G.: Quantitative digital microscopy with deep learning. Appl. Phys. Rev. (2021). https://doi.org/10.1063/5.003489110.1063/5.0034891 ↗
17. Stringer, C., Wang, T., Michaelos, M., Pachitariu, M.: Cellpose: a generalist algorithm for cellular segmentation. Nat. Methods 18, 100–106 (2021). https://doi.org/10.1038/s41592-020-01018-x10.1038/s41592-020-01018-x ↗
18. Liu, Z., Zhang, H., Jin, L., Chen, J., Nedzved, A., Ablameyko, S., Ma, Q., Yu, J., Xu, Y.: U-net-based deep learning for tracking and quantitative analysis of intracellular vesicles in time-lapse microscopy images. J. Innov. Opt. Health Sci. (2022). https://doi.org/10.1142/s179354582250031610.1142/s1793545822500316 ↗
19. Weigert, M., Schmidt, U.: Nuclei instance segmentation and classification in histopathology images with stardist. In: The IEEE International Symposium on Biomedical Imaging Challenges (ISBIC) (2022). https://doi.org/10.1109/ISBIC56247.2022.985453410.1109/ISBIC56247.2022.9854534 ↗
20. Niemann, A., Puzyrev, D., Stannarius, R.: ParticleTracking: A GUI and library for particle tracking on stereo camera images. J. Open Source Softw. 10, 5986 (2025) https://doi.org/10.21105/joss.0598610.21105/joss.05986 ↗
21. He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-cnn. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969. (2017)10.1109/ICCV.2017.322 ↗
22. Dillavou, S., Hanlan, J.M., Chieco, A.T., Xiao, H., Fulco, S., Turner, K.T., Durian, D.J.: Bellybutton: accessible and customizable deep-learning image segmentation. Sci. Rep. 14, 14281 (2024). https://doi.org/10.1038/s41598-024-63906-y10.1038/s41598-024-63906-y ↗
23. Ronneberger, O., Fischer, P., Brox, T.: U-net: Convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_2810.1007/978-3-319-24574-4_28 ↗
24. Liang, J., Liu, X., Chen, T., Pan, C., Xu, C.: Particle identification in particle tracking velocimetry using two-stage neural networks. J. Ind. Manage. Optim. 19, 5331–5352 (2023). https://doi.org/10.3934/jimo.202217510.3934/jimo.2022175 ↗
25. Sanvitale, N., Gheller, C., Bowman, E.: Deep learning assisted particle identification in photoelastic images of granular flows. Granul. Matter 24, 65 (2022). https://doi.org/10.1007/s10035-022-01222-w10.1007/s10035-022-01222-w ↗
26. Shao, S., Mallery, K., Kumar, S.S., Hong, J.: Machine learning holography for 3D particle field imaging. Opt. Express 28, 2987–2999 (2020). https://doi.org/10.1364/OE.37948010.1364/OE.379480 ↗
27. Liu, X., Zhang, Y., Jing, H., Wang, L., Zhao, S.: Ore image segmentation method using U-Net and Res_unet convolutional networks. RSC Adv. 10, 9396–9406 (2020). https://doi.org/10.1039/C9RA05877J10.1039/C9RA05877J ↗
28. Wang, W., Li, Q., Xiao, C., Zhang, D., Miao, L., Wang, L.: An Improved Boundary-Aware U-Net for Ore Image Semantic Segmentation. Sensors 21, 2615 (2021). https://doi.org/10.3390/s2108261510.3390/s21082615 ↗
29. Yu, J., Meng, L., Ren, S., Song, X., Liang, H., Cao, J., Xue, Y., Zhou, W.: A method for identifying fragmentation of open-pit mining blasting based on a new hybrid convolutional neural network. Granul. Matter 27, 62 (2025). https://doi.org/10.1007/s10035-025-01542-710.1007/s10035-025-01542-7 ↗
30. Puthalath, F.: UNet-for-Particle-detection. https://github.com/pfahad/UNet-for-Particle-detection (2026)
31. Cornelius, M.: ZARM Drop Tower Bremen User Manual. In: ZARM Drop Tower Operation and Service Company, (2023)
32. Cheng, Z., Wang, J.: Improved region growing method for image segmentation of three-phase materials. Powder Technol. 368, 80–89 (2020). https://doi.org/10.1016/j.powtec.2020.04.03210.1016/j.powtec.2020.04.032 ↗
33. Kapoor, S., Narayanan, A.: Leakage and the Reproducibility Crisis in ML-based Science. arXiv. arXiv:2207.07048 [cs, stat] (2022). https://doi.org/10.48550/arXiv.2207.0704810.48550/arXiv.2207.07048 ↗
34. Bhattiprolu, S.: Defining U-net in Python using Keras. https://github.com/bnsreenu/python_for_microscopists/blob/master/074-Defining U-net in Python using Keras.py. Last accessed: Jan 31, 2020 (2020)
35. Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313, 504–507 (2006). https://doi.org/10.1126/science.112764710.1126/science.1127647 ↗
36. Lin, T.-Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. arXiv. arXiv:1708.02002 [cs] (2018). https://doi.org/10.48550/arXiv.1708.0200210.48550/arXiv.1708.02002 ↗
37. Sudre, C.H., Li, W., Vercauteren, T., Ourselin, S., Jorge Cardoso, M.: Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. In: Cardoso, M.J., Arbel, T., Carneiro, G., Syeda-Mahmood, T., Tavares, J.M.R.S., Moradi, M., Bradley, A., Greenspan, H., Papa, J.P., Madabhushi, A., Nascimento, J.C., Cardoso, J.S., Belagiannis, V., Lu, Z. (eds.) Deep learning in medical image analysis and multimodal learning for clinical decision support, pp. 240–248. Springer, Cham (2017)10.1007/978-3-319-67558-9_28 ↗
38. Rueden, C.T., Schindelin, J., Hiner, M.C., DeZonia, B.E., Walter, A.E., Arena, E.T., Eliceiri, K.W.: Imagej 2: Imagej for the next generation of scientific image data. BMC Bioinform. 18, 529 (2017). https://doi.org/10.1186/s12859-017-1934-z10.1186/s12859-017-1934-z ↗
39. Beucher, S., L.C.: Use of watersheds in contour detection. International Workshop on Image Processing: Real-time Edge and Motion Detection/Estimation, 12–21 (1979)
40. The F2 score depends on the chosen distance threshold; however, it saturates for thresholds above approximately 8 pixels, as increasing the cutoff does not yield additional correct matches
41. Tkachenko, M., Malyuk, M., Holmanyuk, A., Liubimov, N.: Label Studio: Data labeling software (2020-2025). https://github.com/HumanSignal/label-studio
42. This effect could be counteracted by adding a small random perturbation $$-0.01<\epsilon <0.01$$ to every particle position that happens to be an integer. Together with rounding by floor, this would with a 50% probability change the position of those particles coming from the ’snapping region’ to the next smaller integer. However, a better way to solve the problem the are anti-aliased masks described in the next subsection
43. Ester, M., Kriegel, H.-P., Sander, J., Xu, X.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), pp. 226–231. (1996)
44. CC BY-SA 4.0 license: https://creativecommons.org/licenses/by-sa/4.0/