Andreas Arzt, Gerhard Widmer,
"Real-time Music Tracking Using Multiple Performances as a Reference"
: Proceedings of the 16th International Society of Information Retrieval Conference, 10-2015
Original Titel:
Real-time Music Tracking Using Multiple Performances as a Reference
Sprache des Titels:
Englisch
Original Buchtitel:
Proceedings of the 16th International Society of Information Retrieval Conference
Original Kurzfassung:
In general, algorithms for real-time music tracking directly
use a symbolic representation of the score, or a synthesised
version thereof, as a reference for the on-line alignment
process. In this paper we present an alternative approach.
First, different performances of the piece in question
are collected and aligned (off-line) to the symbolic
score. Then, multiple instances of the on-line tracking algorithm
(each using a different performance as a reference)
are used to follow the live performance, and their output is
combined to come up with the current position in the score.
As the evaluation shows, this strategy improves both the
robustness and the precision, especially on pieces that are
generally hard to track (e.g. pieces with extreme, abrupt
tempo changes, or orchestral pieces with a high degree of
polyphony). Finally, we describe a real-world application,
where this music tracking algorithm was used to follow a
world-famous orchestra in a concert hall in order to show
synchronised visual content (the sheet music, explanatory
text and videos) to members of the audience.
Forschungs-