Interactive Mobile Music Performance with Digital Compass

Bongjun Kim and Woon Seung Yeo

Audio & Interactive Media (AIM) Lab Graduate School of Culture Technology, KAIST

Daejeon, 305-701, Korea Republic

bongjun@kaist.ac.kr, woony@kaist.edu

Abstract

In this paper we introduce an interactive mobile music performance system using the digital compass of mobile phones. Compass-based interface can detect the aiming orientation of performers on stage, allowing us to obtain information on interactions between performers and use it for both musical mappings and visualizations on screen for the audience. We document and discuss the result of a compass-based mobile music performance, Where Are YouStanding, and present an algorithm for a new app to track down the performers’ positions in real-time.

picture1

System Overview

system

Fig 1: System for compass-based mobile music performance

Player Setup

formation

Fig 2: Formation of performers and possible events in a four-player setup

CASE 1: Aiming Directions

Video 1: Performance of Where Are You Standing by the KAIST Mobile Phone Orchestra (KAMPO)

(If the video is not played, please click this link)

CASE 2: Aiming with Movement

Video 2: Visualization of Changes in on-stage formation of performers. Distances between performers were mapped to interonset interval (IOI).

(If the video is not played, please click this link)