Hamid Eghbal-Zadeh, Richard Vogl, Gerhard Widmer, Peter Knees,
"GANs and Poses: An Interactive Generative Music Installation Controlled by Dance Moves"
: Proceedings of ISMIR2018 Interactive Machine-Learning for Music (IML4M) @Exhibition, 9-2018
Original Titel:
GANs and Poses: An Interactive Generative Music Installation Controlled by Dance Moves
Sprache des Titels:
Englisch
Original Buchtitel:
Proceedings of ISMIR2018 Interactive Machine-Learning for Music (IML4M) @Exhibition
Original Kurzfassung:
GANs and Poses is an interactive multi-media installation
using human poses to control artificial neural networks generating
parts for a music arrangement. To provide incentive
for interaction, a game-style UI rewards the audience with
audio-visual feedback, which in turn drives the progress
through the musical arrangement. This work uses a variety
of artificial neural networks to (i) detect persons and their
body posture, (ii) classify dance moves, and (iii) generate
drum as well as melody patterns.
Forschungs-