D a n c e   t o   t h e   M u s i c   /   P l a y   t o   t h e   M o t i o n

The intention of this work is to explore how motion can be used to guide music composition. We introduce a method for synthesizing an original music piece based on the analysis of a dancer's movement. First, the dance is captured using motion capture technology. Then, the performance is segmented according to the boundaries of the musical phrases, and the similarities between movements are analysed in order to build a measure-synchronous motion graph. Finally, a constrained random walk in such a graph guides the composition of a new song. The automatic composition algorithm makes use of high level parameters, such as the melody instrument and the number of notes per beat, which are provided by the random walk in the motion graph.

I collaborated on this project solving aspects related with lighting and rendering. See the web site to know more about the project and researching team.