This project is proposed and researched by Masataka Goto .
English version is here .
The players not only improvise together as in a conventional jam session, but also observe the virtual dancer, whose motion is changed in real time according to their musical performance. In other words, they can communicate using both auditory information and visual information. The purpose of this research is to achieve a new mode of interaction in which CG and music are closely integrated by a lifelike computer character. In real jam sessions, musical interaction between players is essential and is achieved by exchanging not only auditory information but also auxiliary visual information such as gestures that indicate repetition or the end of song. To enhance the visual interaction in a jam session and provide players with more expressive way to communicate, we introduce a virtual dancer called Cindy visible to both players.