RT Conference Proceedings T1 Evaluation framework for automatic singing transcription A1 Molina, Emilio A1 Barbancho-Pérez, Ana María A1 Tardón-García, Lorenzo José A1 Barbancho-Pérez, Isabel K1 Música - Proceso de datos AB In this paper, we analyse the evaluation strategies used in previous works on automatic singing transcription, and we present a novel, comprehensive and freely available evaluation framework for automatic singing transcription. This framework consists of a cross-annotated dataset and a set of extended evaluation measures, which are integrated in a Matlab toolbox. The presented evaluation measures are based on standard MIREX note-tracking measures, but they provide extra information about the type of errors made by the singing transcriber. Finally, a practical case of use is presented, in which the evaluation framework has been used to perform a comparison in detail of several state-of-the-art singing transcribers. LK http://hdl.handle.net/10630/8372 UL http://hdl.handle.net/10630/8372 LA eng NO Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech. This work has been funded by the Ministerio de Economía y Competitividad of the Spanish Government under Project No. TIN2013-47276-C6-2-R and by the Junta de Andalucía under Project No. P11-TIC-7154. DS RIUMA. Repositorio Institucional de la Universidad de Málaga RD 6 mar 2026