Interaction with Sound & Music

Lalya Gaye, Viktoria Institute
Guest lectures and workshop at Information Art & Design course - Prof A. Kubota
Department of Interaction Design, Tama Art University, Tokyo, Japan
September 2005


Topic

Introduction to interaction design & prototyping methods for sound-art students, with a focus on:
- design of electronic music controllers / sound installations
- sound applications for everyday life (e.g. mobile & locative audio)

Design exercices

Rapid prototyping of mobile audio applications using bodystorming and interaction relabelling. [Documentation]

 
Power point slides
 

Day 1:
Brief overview of my work
Design space: music controller
Design space: everyday interfacing with sound (e.g. mobile & locative audio)

Day 2:
Prototyping methods
Case study: mobile music project
Design exercises: rapid prototyping activities

Literature

Sound
* Reading Sounds or an essay on sounds, music, knowledge, rock & society - Philip Tagg
* Turntable Music - Kjetil Falkenberg Hansen
* Walking Through Sound - David Toop
* Composing Noise - Jaeho Chang
* The Art of Noises - Luigi Russolo (extract)
* Experimental Music (Cage and Beyond) - Michael Nyman
* MODULATIONS: A History of Electronic Music - Throbbing Words on Sound - Ed. Peter Shapiro
* Noise, Water, Meat: A History of Sound in the Arts - Douglas Kahn
* Oceans of Sound - David Toop
* Sonic Boom - David Toop
* The Tuning of the World - E. Murray Schafer
* Acoustic Communication - Barry Truax

Music controllers design
* The Importance of Parameter Mapping in Electronic Instrument Design - Andy Hunt
* Making Motion Musical: Gesture Mapping Strategies for Interactive Computer Music - Todd Winkler
* Electronic Music Interfaces - Joe Paradiso
* A Course on Controllers - Bill Verplank, Craig Sapp, Max Mathews
* Principles for Designing Computer Music Controllers - Perry Cook
* NIME proceedings: 2001 - 2002 - 2003 - 2004 - 2005
* Interactive Music Systems - Robert Rowe
* Composing Interactive Music - Todd Winkler
* Trends in Gestural Control of Music (eBook)
* Computer Music : Synthesis, Composition and Performance - Charles Dodge & Thomas A. Jerse
* Physical Computing - Dan O'Sullivan & Tom Igoe

Prototyping methods
* What Do Prototypes Prototype - Stephanie Houde & Charles Hill
* Experience Prototyping - Marion Buchenau and Jane Fulton Suri
* Understanding Context by Being There - Case Studies in Bodystorming - Antti Oulasvirta, Esko Kurvinen and Tomi Kankainen
* Design: Cultural Probes - Bill Gavor, Tony Dunne and Elena Pacenti
* Urban probes: Encountering Our Emerging Urban Atmospheres - Eric Paulos and Tom Jenkins

Mobile music & locative audio
* Sonic City: The Urban Environment as a Musical Interface - Lalya Gaye, Ramia Mazé, Lars Erik Holmquist
* In Duet with Everyday Urban Settings: A User Study of Sonic City - Lalya Gaye and Lars Erik Holmquist
* Malleable Mobile Music - Atau Tanaka
* SoundPryer: Truly Mobile Joint Music Listening - Mattias Östergren and Oskar Juhlin
* tunA: Synchronised Music-Sharing on Handheld Devices - Arianna Bassoli, Julian Moore and Stefan Agamanolis
* Push!Music: Intelligent Music Sharing on Mobile Devices - Mattias Jacobsson, Mattias Rost, Maria Håkansson, Lars Erik Holmquist
* Bass-Station: A Community-Based Information Space - Mark Argot
* Location 33: A Mobile Musical - William Carter, Leslie S. Liu
* The New Cosmopolites: Activating the Role of Mobile Music Listeners - Gideon d'Arcangelo
* Mobile Phone Music. Sound Art and 'Mobile Devices' - Frauke Berhendt
* From Calling a Cloud to Finding the Missing Track: Artistic Approaches to Mobile Music - Frauke Behrendt
* Sound Mapping: An Assertion of Space - Iain Mott and Jim Sosnin
* netzwissenschaft.de's list of references about mobile music

Links

Project examples & references

Lalya's projects
* Sonic City (video)
* Tejp / audio tags
* Context Photography
* Tap-n-Bass
* Attack of the PANTS
* Mobile Music workshops

Music interfaces for performances and installations
* Takuro Mizuta Lippit, Turntablism
* Hyperinstruments
* 8Tunnel2 (interview)
* Kanta Horio (videos)
* MIDI Scrapyard Challenge
* The Hands
* Magic carpet (video)
* Global String
* Musical jeans jacket (video)
* TGarden (video)
* Expressive footwear (video)
* ensemble
* Audiopad (video)
* Block Jam (video)
* Virtual Instruments
* Modified Toy Orchestra
* Manual Input Sessions (see videos)
* Guitarbot (LEMUR) (video)
* Cutaneous grooves
* Tap Tap
* Soundbug
* Spherical Speakers
* Flower Speakers [1] [2]
* Transparent headphones
* Audio Spotlight
* Dark Around the Edges
* Very Nervous System
* DIEM Digital Dance System (video)
* Hypercello (video)
* Unfoldings
* Stranglophone (video)
* Lady's Glove (video)
* Music Shapers
* Radio Baton (video)
* Tooka (video)
* Crackle family
* Dialtones (audio)
* Sine Wave Orchestra
* Le Placard

Alternative uses of sound in everyday life
* Blendie (video)
* Context Photography
* RAW
* ambientROOM

Locative audio & mobile music
* Hear&There
* Tacticle Sound Garden
* Tejp / audio tags
* BIT Radio
* Key Chain Radio Station
* New Beginnings radio projects
* NIM & Sintheta
* SoundPryer
* TunA
* Push!Music
* Bass Station
* Sonic City (video)
* Malleable Mobile Music
* Sound Mapping (video)
* Sonic Interface
* CosTune
* Sound Lens (video)
* Electric walks
* Drift
* Seven Mile Boots
* The Case at Kulturhuset
* Riot!
* 34 North 118 West
* Location 33
* Personal Instrument (Wodiczko)
* Personal Instrument (Hugues)
* Nomadic Radio
* Sonic Fabric
* Justice Yeldham & the dynamic ribbon device
(video)
* Parkour (videos)

Interaction design methods
* Cultural probes
+ see literature list



Resources
* Obsolete's history of electronic music
* Interactive Systems and Instrument Design in Music - Working group
* Gesture Research in Music
* Dance Technology Zone
* Axel Mulder's list of webpages
* .microsound
* oddmusic
* EMF
* Obsolete's resources
* near near future / sound
* MotionTracking Issues
* acusmatica
* ArtsElectric
* Circuit Bending
* Human Tracking Technology
* DIY improvised sound
* Mobile Art and Locative Media Resources
* TCM Locative Media

Blogs & reblogs
* near near future
* Eyebeam/reblog
* Networked performance
* Dance and Technology weblog
* Music Thing
* Pixelsumo


Institutions & communities
* idd @ Tama Arts University
* T-Kougei Media Arts
* STEIM
* IRCAM
* MIT Media Lab: MMM, a+c group
* Media Lab Europe
* Future Applications Lab
* Interactive Institute: Mobility, Sonic, Re:Form
* Bureau of Inverse Technology
* TMH/KTH
* Sony CSL: Paris, Tokyo
* IUA Pompeu Fabra
* Columbia CMC
* DIEM
* Simon Fraser University
* CIRMMT McGill
* CNMAT
* DIKU Music Informatics
* TKK Akustiika
* MTG York
* CCRMA
* CRCA-UCSD
* OSU Dance-tech
* IEM
* IFTAF
* INA GRM
* FoAM
* sponge
* Topological Media Lab
* LEMUR
* Madagascar Institute
* ITP/NYU
* RCA Interaction Design
* Interaction Design Institute Ivrea
* La kitchen
* Fylkingen / EMS
* ICMA
* NOTAM
* Dept. Media Art, Tokyo Polytechnic Univ.
* Brown University Music Department
* HCT-UBC
* Harvestworks
* IMEB
* Institute of Sonology
* Reverberant
* NIFCA
* Interactive Music Network
* Pervasive and Locative Arts Network
* Dorkbot - Dorkbot Tokyo

Festivals & conferences
* Mobile Music workshops
* NIME
* ICMC
* Cybersonica
* Mutek
* GAS festival
* Norberg festival
* DAFX
* Résonances
* ICAD
* PEVOC
* Sónar
* Dissonanze
* Futuresonic
* Bent 2004
* Ars Electronica
* ISEA 2004
* SSAW'04
* Bend++