journal article·2020-04-03Open access

Automatic Staff Reconstruction within SIMSSA Project

Lorenzo J. Tardón, Isabel Barbancho, Ana M. Barbancho, Ichiro Fujinaga

Applied Sciences· Volume 10· Issue 7

Abstract

The automatic analysis of scores has been a research topic of interest for the last few decades and still is since music databases that include musical scores are currently being created to make musical content available to the public, including scores of ancient music. For the correct analysis of music elements and their interpretation, the identification of staff lines is of key importance. In this paper, a scheme to post-process the output of a previous musical object identification system is described. This system allows the reconstruction by means of detection, tracking and interpolation of the staff lines of ancient scores from the digital Salzinnes Database. The scheme developed shows a remarkable performance on the specific task it was created for.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Music and Audio Processing · Digital Media Forensic Detection · Diverse Musicological Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

ATIC Research Group, Dpto. Ingeniería de Comunicaciones, Universidad de Málaga, Andalucía Tech, Campus Universitario de Teatinos s/n, 29071 Málaga, Spain

Schulich School of Music, McGill University, Montreal, QC H3A 1E3, Canada

Funding

Ministerio de Economía y Competitividad of the Spanish Government · Universidad de Málaga, Campus de Excelencia Internacional Andalucía Tech

References (31)

Show source-provided references
1. Blostein, D., and Baird, H.S. (1992). A critical survey of music image analysis. Structured Document Image Analysis, Springer.10.1007/978-3-642-77281-8_19 ↗
2. The challenge of optical music recognition10.1023/A:1002485918032 ↗
3. Optical music recognition: State-of-the-art and open issues10.1007/s13735-012-0004-6 ↗
4. Pinto, T., Rebelo, A., Giraldi, G., and Cardoso, J.S. (2011, January 8–10). Music score binarization based on domain knowledge. Proceedings of the Iberian Conference on Pattern Recognition and Image Analysis, Las Palmas de Gran Canaria, Spain.10.1007/978-3-642-21257-4_87 ↗
5. Calvo-Zaragoza, J., Vigliensoni, G., and Fujinaga, I. (2017, January 8–12). Pixel-wise binarization of musical documents with convolutional neural networks. Proceedings of the 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA), Nagoya, Japan.10.23919/MVA.2017.7986876 ↗
6. Staff detection with stable paths10.1109/TPAMI.2009.34 ↗
7. Su, B., Lu, S., Pal, U., and Tan, C.L. (2012, January 27–29). An effective staff detection and removal technique for musical documents. Proceedings of the 2012 10th IAPR International Workshop on Document Analysis Systems, Gold Coast, QLD, Australia.10.1109/DAS.2012.16 ↗
8. A new optical music recognition system based on combined neural network10.1016/j.patrec.2015.02.002 ↗
9. Pacha, A., Hajič, J., and Calvo-Zaragoza, J. (2018). A baseline for general music object detection with deep learning. Appl. Sci., 8.10.3390/app8091488 ↗
10. Optical music recognition for scores written in white mensural notation
11. Optical recognition of music symbols10.1007/s10032-009-0100-1 ↗
12. Wen, C., Zhang, J., Rebelo, A., and Cheng, F. (2016). A directed acyclic graph-large margin distribution machine model for music symbol classification. PLoS ONE, 11.10.1371/journal.pone.0149688 ↗
13. Pacha, A., and Eidenberger, H. (2017, January 9–15). Towards a universal music symbol classifier. Proceedings of the 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), Kyoto, Japan.10.1109/ICDAR.2017.265 ↗
14. Calvo-Zaragoza, J., Vigliensoni, G., and Fujinaga, I. (2017, January 24–26). A machine learning framework for the categorization of elements in images of musical documents. Proceedings of the Third International Conference on Technologies for Music Notation and Representation, La Coruña, Spain.
15. Hajič, J., and Pecina, P. (2017, January 9–12). The MUSCIMA++ dataset for handwritten optical music recognition. Proceedings of the 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), Kyoto, Japan.10.1109/ICDAR.2017.16 ↗
16. Hajic, J., Dorfer, M., Widmer, G., and Pecina, P. (2018, January 23–27). Towards full-pipeline handwritten OMR with musical symbol detection by U-Nets. Proceedings of the 19th International Society for Music Information Retrieval Conference, ISMIR 2018, Paris, France.
17. Pacha, A., and Calvo-Zaragoza, J. (2018, January 23–27). Optical music recognition in mensural notation with region-based convolutional neural networks. Proceedings of the 19th International Society for Music Information Retrieval Conference, ISMIR 2018, Paris, France.
18. Bainbridge, D., and Bell, T. (1997, January 14–17). Dealing with superimposed objects in optical music recognition. Proceedings of the Sixth International Conference on Image Processing and Its Applications, Venue, Dublin.10.1049/cp:19970997 ↗
19. A comparative study of staff removal algorithms10.1109/TPAMI.2007.70749 ↗
20. Fujinaga, I., Hankinson, A., and Cumming, J.E. (2014, January 12). Introduction to SIMSSA (single interface for music score searching and analysis). Proceedings of the 1st International Workshop on Digital Libraries for Musicology, London, UK.10.1145/2660168.2660184 ↗
21. Calvo-Zaragoza, J., Vigliensoni, G., and Fujinaga, I. (December, January 28). Pixelwise classification for music document analysis. Proceedings of the 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA), Montreal, QC, Canada.10.1109/IPTA.2017.8310134 ↗
22. Calvo-Zaragoza, J., Castellanos, F.J., Vigliensoni, G., and Fujinaga, I. (2018). Deep neural networks for document processing of music score images. Appl. Sci., 8.10.3390/app8050654 ↗
23. A threshold selection method from gray-level histograms10.1109/TSMC.1979.4310076 ↗
24. Vincent, L. (1993, January 10–14). Grayscale area openings and closings, their efficient implementation and applications. Proceedings of the EURASIP First Workshop on Mathematical Morphology and its Applications to Signal Processing, Barcelona, Spain.
25. Serra, J. (1983). Image Analysis and Mathematical Morphology, Academic Press, Inc.
26. Gonzalez, R.C., and Woods, R.E. (2007). Digital Image Processing, Pearson.
27. Fujinaga, I. (1996). Adaptive Optical Music Recognition. [Ph.D. Thesis, McGill University].
28. Szwoch, M. (2005, January 5–8). A robust detector for distorted music staves. Proceedings of the International Conference on Computer Analysis of Images and Patterns, Versailles, France.10.1007/11556121_86 ↗
29. MathWorks (2020, March 23). Smoothing Splines. Available online: https://uk.mathworks.com/help/curvefit/smoothing-splines.html.
30. Carter, N.P., and Bacon, R.A. (1992). Automatic recognition of printed music. Structured Document Image Analysis, Springer.10.1007/978-3-642-77281-8_21 ↗
31. Cardoso, J.S., Capela, A., Rebelo, A., and Guedes, C. (2008, January 12–15). A connected path approach for staff detection on a music score. Proceedings of the 2008 15th IEEE International Conference on Image Processing, San Diego, CA, USA.10.1109/ICIP.2008.4711927 ↗