- Research Article
- Open Access
Robust and Adaptive OMR System Including Fuzzy Modeling, Fusion of Musical Rules, and Possible Error Detection
EURASIP Journal on Advances in Signal Processing volume 2007, Article number: 081541 (2006)
This paper describes a system for optical music recognition (OMR) in case of monophonic typeset scores. After clarifying the difficulties specific to this domain, we propose appropriate solutions at both image analysis level and high-level interpretation. Thus, a recognition and segmentation method is designed, that allows dealing with common printing defects and numerous symbol interconnections. Then, musical rules are modeled and integrated, in order to make a consistent decision. This high-level interpretation step relies on the fuzzy sets and possibility framework, since it allows dealing with symbol variability, flexibility, and imprecision of music rules, and merging all these heterogeneous pieces of information. Other innovative features are the indication of potential errors and the possibility of applying learning procedures, in order to gain in robustness. Experiments conducted on a large data base show that the proposed method constitutes an interesting contribution to OMR.
Rossant F, Bloch I: A fuzzy model for optical recognition of musical scores. Fuzzy Sets and Systems 2004,141(2):165–201. 10.1016/S0165-0114(03)00094-0
Blostein D, Baird H: A critical survey of music image analysis. In Structured Document Image Analysis. Edited by: Baird HS, Bunke H, Yamamoto K. Springer, Berlin, Germany; 1992:405–434.
Carter N, Bacon R, Messenger T: The acquisition, representation and reconstruction of printed music by computer: a review. Computer and the Humanities 1988,22(2):117–136. 10.1007/BF00057651
SmartScore 3.2 Pro Demo. https://doi.org/www.musitek.com
Bainbridge D, Bell TC: Dealing with superimposed objects in optical music recognition. Proceedings of 6th International Conference on Image Processing and Its Applications, July 1997, Dublin, Ireland 2: 756–760.
Bellini P, Bruno I, Nesi P: Optical music sheet segmentation. Proceedings of 1st International Conference on Web Delivering of Music (WEDELMUSIC '01), November 2001, Florence, Italy 183–190.
Coüasnon B, Camillerapp J: Using grammars to segment and recognize music scores. International Association for Pattern Recognition Workshop on Document Analysis Systems (DAS '94), October 1994, Kaiserslautern, Germany 15–27.
Ng KC, Boyle RD: Recognition and reconstruction of primitives in music scores. Image and Vision Computing 1996,14(1):39–46. 10.1016/0262-8856(95)01038-6
Bainbridge D, Bell T: An extensible optical music recognition system. Proceedings of the 19th Australasian Computer Science Conference (ACSC '96), January-February 1996, Melbourne, Australia 308–317.
Fujinaga I: Adaptive optical music recognition, Ph. D. dissertation. McGill University, Montreal, Calif, USA, 1997.
Carter N, Bacon R: Automatic recognition of printed music. In Structured Document Image Analysis. Edited by: Baird HS, Bunke H, Yamamoto K. Springer, Berlin, Germany; 1992:456–465.
Bainbridge D, Bell T: A music notation construction engine for optical music recognition. Software: Practice and Experience 2003,33(2):173–200. 10.1002/spe.502
Droettboom M, Fujinaga I, MacMillan K: Optical music interpretation. Proceedings of the International Workshops on the Statistical, Structural and Syntactic Pattern Recognition Conference (SSPR '02), August 2002, Windsor, Canada 378–386.
Fahmy H, Blostein D: A graph-rewriting paradigm for discrete relaxation: application to sheet-music recognition. International Journal of Pattern Recognition and Artificial Intelligence 1998,12(6):763–799. 10.1142/S0218001498000439
Kato H, Inokuchi S: The recognition system of printed piano using musical knowledge and constraints. Proceedings of IAPR Workshop on Syntactic and Structured Pattern Recognition, June 1990, Murray Hill, NJ, USA 231–248.
Blostein D, Haken L: Using diagram generation software to improve diagram recognition: a case study of music notation. IEEE Transactions on Pattern Analysis and Machine Intelligence 1999,21(11):1121–1136. 10.1109/34.809106
Coüasnon B, Rétif B: Using a grammar for a reliable full score recognition system. Proceedings of International Computer Music Conference (ICMC '95), September 1995, Banff, Canada 187–194.
Ferrand M, Leite JA, Cardoso A: Improving optical music recognition by means of abductive constraint logic programming. Proceedings of the 9th Portuguese Conference on Artificial Intelligence (EPIA '99), September 1999, Évora, Portugal 342–356.
Su M-C, Tew C-Y, Chen H-H: Musical symbol recognition using SOM-based fuzzy systems. Proceedings of 20th International Conference of the North American Fuzzy Information Processing Society and the International Fuzzy Systems Association, July 2001, Vancouver, BC, Canada 4: 2150–2153.
Watkins G: The use of fuzzy graph grammars for recognising noisy two-dimensional images. Proceedings of Biennial Conference of the North American Fuzzy Information Processing Society (NAFIPS '96), June 1996, Berkeley, Calif, USA 415–419.
Bloch I: Information combination operators for data fusion: a comparative review with classification. IEEE Transactions on Systems, Man, and Cybernetics, Part A 1996,26(1):52–67. 10.1109/3468.477860
Bloch I, Maître H: Fusion of image information under imprecision. In Aggregation and Fusion of Imperfect Information, Studies in Fuzziness and Soft Computing. Volume 12. Edited by: Bouchon-Meunier B. Springer, Berlin, Germany; 1997:189–213.
Dubois D, Prade H: Fuzzy Sets and Systems: Theory and Applications. Academic Press, New York, NY, USA; 1980.
Dubois D, Prade H, Yager RR: Merging fuzzy information. In Approximate Reasoning and Information Systems, Handbook of Fuzzy Sets. Edited by: Bezdek JC, Dubois D, Prade H. Kluwer Academic, Norwell, Mass, USA; 1999:335–401. chapter 6
Rossant F: A global method for music symbol recognition in typeset music sheets. Pattern Recognition Letters 2002,23(10):1129–1141. 10.1016/S0167-8655(02)00036-3
Rossant F, Bloch I: Optical music recognition based on a fuzzy modeling of symbol classes and music writing rules. Proceedings of IEEE International Conference on Image Processing (ICIP '05), September 2005, Genova, Italy 2: 538–541.
d' Andecy VP, Camillerapp J, Leplumey I: Kalman filtering for segment detection: application to music scores analysis. Proceedings of the 12th International Conference on Pattern Recognition (ICPR '94), October 1994, Jerusalem, Israel 1: 301–305.
Fujinaga I, Moore S, Sullivan DS: Implementation of exemplar-based learning model for music cognition. Proceedings of the 5th International Conference on Music Perception and Cognition (ICMPC '98), August 1998, Seoul, Korea 171–179.
Martin P, Bellissant C: Low-level analysis of music drawings images. Proceedings of the 1st International Conference on Document Analysis and Recognition (ICDAR '91), 1991, Saint-Malo, France 417–425.
Armand J-P: Musical score recognition: a hierarchical and recursive approach. Proceedings of the 2nd International Conference on Document Analysis and Recognition (ICDAR '93), October 1993, Tsukuba Science City, Japan 906–909.
Fujinaga I: Optical music recognition using projections, M.S. thesis. McGill University, Montreal, Calif, USA; 1988.
Reed KT, Parker JR: Automatic computer recognition of printed music. Proceedings of the 13th International Conference on Pattern Recognition (ICPR '96), August 1996, Vienna, Austria 3: 803–807.
Randriamahefa R, Cocquerez JP, Fluhr C, Pépin F, Philipp S: Printed music recognition. Proceedings of the 2nd International Conference on Document Analysis and Recognition (ICDAR '93), October 1993, Tsukuba Science City, Japan 898–901.
McPherson JR, Bainbridge D: Coordinating knowledge within an optical music recognition system. The 4th New Zealand Computer Science Research Students' Conference (NZCSRSC '01), April 2001, Christchurch, New Zealand 50–58.
About this article
Cite this article
Rossant, F., Bloch, I. Robust and Adaptive OMR System Including Fuzzy Modeling, Fusion of Musical Rules, and Possible Error Detection. EURASIP J. Adv. Signal Process. 2007, 081541 (2006). https://doi.org/10.1155/2007/81541
- Quantum Information
- Segmentation Method
- Error Detection
- Fuzzy Modeling
- Potential Error