| Interaction with Sound & Music Lalya Gaye, Viktoria Institute Guest lectures and workshop at Information Art & Design course - Prof A. Kubota Department of Interaction Design, Tama Art University, Tokyo, Japan September 2005 |
 |
<< back to main page
The lectures about interaction with sound and music ended with a small workshop in which students made scenarios and rapid prototypes of mobile audio applications.
This page describes :
- the methods of bodystorming and interaction relabeling used during the workshop
- the brainstorming session during which the students developped simple applications ideas about mobile audio
- 3 scenarios of use further developed and prototyped by enactement by the students.
Students participating in the workshop activities included:
- Group1: Mr Yamaguchi, Mr Inafuku, Mr Kojima
- Group2: Mr Mori, Miss Suzuki, Miss Shinuzu
- Group3: Mr Higa, Mr Ogata, Mr Hayashi, Miss Hasegawa
The students were divided in groups of 3-4 people. They first brainstormed simple application ideas for mobile and locative audio, selected one particular idea per group (the one that the rest of the class found most interesting), then further developed them using bodystorming and/or interaction relabeling. Finally, they presented their application ideas and scenarios in front of the class.
* Scenario bodystorming consists of developing and physically enacting scenarios of use. By using this method, students can get an embodied understanding of issues surrounding design and use.
* Interaction relabelling consists of working with unrelated products to develop new forms of interaction. In this workshop, students could take existing electronic or mechanical artefacts, pretend they were mobile or locative audio devices, and tell and act out how they would work.
* The students could also support their scenarios using MAX/MSP or other prototyping tools they had already been working on (f.ex. already built portable speakers in 'pet sound battle system').
[For references about the bodystorming and interaction relabeling methods, please see the literature list on the main page]
 Interaction relabelling |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
Application ideas
* Group 1
 Brainstorm paper sheet - group 1 |
 Train noise un-cancellation |
 Pet sound battle system |
 Ad hoc music
sharing with ranking
|
 Sound graffiti |
 Bicycle music
with speed matching bpm
|
* Group 2
 Brainstorm paper sheet - group 2 |
 Sonification of bus arrival |
 Musical shoes
|
 Ghost sounds following people |
 Portable planetarium |
 Suica card music sharing in Tokyo underground |
 |
 Playing harmonica on a Gameboy card and afterwards remixing the sounds in the Gameboy |
 Musical metro handle / page holder? |
 Sonification of rain on umbrella
|
 Music mixing based on how much
drink left
|
* Group 3
 Brainstorm paper sheet - group 3 |
 Dog-human audio communication system |
 System for humiliating flashers - part I |
 System for humiliating flashers - part II |
 Fart amplifier in public space |
 Audio guiding system for blind people |
 Jet audio transmitter? |
 Amplification of sounds of empty stomachs? |
 Artificial ears? |
 Musical reactive floor? |
 Book music player |
 Musical augmented
reality binoculars?
|
* Group 1: pet sound battle system
When dog-owners meet, the barking of their dogs is translated into music, which turns the encounter into a doggy DJ battle. The barking is hidden by mouth pieces and the music output through portable shoulder speakers worn by the dogs. Two modes are available: - battle mode: dogs engaging into a sound battle where the best dog's barking sound wins - session mode: dogs collaborate in mixing music together. This system is meant to support interaction both between owners and between dogs. |
||
 Sketch of the pet sound battle system |
 Student acting out as a
dog with shoulder speakers
|
 Bodystorming of the battle |
* Group2: Suica card music sharing in Tokyo underground
 Sketch of the Suica card music sharing |
Many people travelling with the Tokyo underground use RFID cards called Suica to pay for their fare. In this proposal, a Suica card user who is listening to music can leave an mp3 at the ticket barrier to be picked-up by the following card user. The following user can either automatically start listening to the song when passing by the barrier, or store it in his/her play-list and listen to it later. One could imagine people tryingn to pass right behind particular people because they look like their music taste might be interestng.This systemcould also be an alternative paying system were users could pay one trip with one song when the card runs out of money. |
|
 Enacting a scenario |
 Traveller leaving an mp3 at the ticket barrier |
 The following traveller picking up the mp3 |
* Group 3: Okasan!
| In the
future, convicted flashers might be released with the condition
of being tracked by the police with GPS, get speakers implanted behind
their ears and of giving away their mum's phone number to the
authorities. If commiting a new offence, two scenarios could take place: |
||
1) the victim could use a voice simlulator connected to a database of mums' voices, so she could sound exactly like the offender's mum while reprimanding him; 2) the police sensing the situation could automatically connect the victim's mobile phone to the offender's mum so she could reprimand her son herself. |
 Sketch part I: flasher offending victim |
 Sketch part II: victim repremanding offender with mother's voice |
 Enacting the
sketches - part I
|
 Enacting the sketches - part II |
|