METHOD The software running this setup is Macromedia Director MX. As the mouse cursor moves around the stage, various audio recordings are triggered using the “MouseEnter” command. Each colour on the stage represents a specific sound and volume level. The panning of the seperate sounds is also triggered in this way.

WHAT IS IT?The “Sound Garden” is a reactive audio project which will attempt to generate visual imagery in the mind of participants. By suppressing the visual sense completely in a pitch back room, it is hoped that the surrounding soundscape will start to trigger visual memories and counjure up fantastical imaginings that start to form a diverse and navigable landscape. The soundscape is heavily influenced by the work of the medieval painter Heronimous Bosch, in particular, his triptych “The Garden of Earthly Delights”. An attempt has been made to re-interpret aspects of this painting as a living and breathing landscape.

The mouse cursor follows the position of the red LED, which is mounted on the top of a set of headphones worn by the participant. The LED is seen by an overhead camera  and it’s location in XY space os continually tracked using the Trackthemcolors Pro Xtra. All audio is sent from the computer to an audio transmitter, which in turn is broadcasting to a small portable FM radio worn by the participant. A set of headphones with a red Led at the top is connected to the radio.   As the participant walks around the space, they are able to hear the shape of the landscape as it unfolds before them.

THE SOUNDGARDEN

Click and hold to play

Andrew Brooks MA Reactive Media Project

WILLEM DE RIDDERVIRTUAL REALITY IN THE DARK (ARS ELECTRONICA 1990) Speaking through a walkman with headphones, Willem de Ridder gives visitors instructions to walk through a sequence of darkening rooms until they are in a pitch black space. Here the story continues as they lie on a bed. Masterful storytelling creates a convincing illusion where “every imposed idea will become real and visible”.   “Most of the brain is geared towards visual stimuli. Any idea or belief tends to materialize”   WEBSITE: http://www.willemderidder.com/

SOUNDTRACK PROCreating the final mix

SOUNDTOYS Soundtoys is an online exhibition space filled with works by audio visual artists. Works take the form of art, games, generative music, interactive environments etc. They are described as “new audiovisual experiences or multimedia experiments” and “a fusion of audio and video output through new technologies” Many projects are shockwave based and will run in your internet browser.   WEBSITE: http://www.soundtoys.net/

POSSIBLE APPLICATIONS: CHILDREN’S GAMES Treasure Hunt: Audio clues given at various places. Red Ball Game: Moving a ball around in a space generates sounds. Red Glove and Musical Objects: Various objects in a room generate sounds when touched.   VISUAL IMPAIRMENT This tool may have applications for assisting with navigation for people with visual impairments.   ART GALLERY TOUR Members of the public can walk around a gallery and get information/commentary about the artworks they choose to visit   GPS: The potential application of this prototype would be increased if it was connected to a GPS system. It could be taken outdoors and streets etc turned into an audio tour or sound-scape environment.

MINIDISK RECORDERRecorder with stereo microphone

INITIAL CONCEPTInvisible “Sound-Objects” that float  around in a space.   PROGRESSIONThe Project slowly developed into a 2-Dimensional space due to the realisation that a third dimension was not really necessary to achieve the required effect. People are not really likely to be bending down or stretching to hear a sound in a dark space. The illusion of  3-Dimensionality is created instead by adjusting the volume (Distance from sound source) and Panning (Direction from sound source).

FIRE

TREE SOUND-MAPPlan of sounds to be used

HEARTBEAT

RIVER SOUND-MAPPlan of sounds to be used

POSSIBLE APPLICATIONS

DRAMA IN THE DARK The Dark, is a 3 Dimensional drama, that takes place in a pitch black room. The participants are able to explore an audio environment of virtual ghosts who recall their stories. The piece is based on the experiences of people on the slave ships during the 1700 and 1800s.   There is also a downloadable version which you can navigate on your computer using the arrow keys.   WEBSITE: http://www.thedark.net

RESEARCH

AUDIOGAMES “Audio Games” are computer games that consist only of sound (no visual output). The game mechanics too, are usually also based on sound.   AudioGames.Net is the largest online archive of sound based games and blind-accessible games. There is also a forum, game reviews and direct links to downloads.   WEBSITE: http://www.audiogames.net/

EARLY DIRECTIONSThis project initially started life in ISADORA, but  soon moved to DIRECTOR, because of limitations in the shape of the hotspot areas and also because I was already familiar with Director.  DIGITAL VIDEO CAMERA  •1 VIDEO RECIEVER  •2 DIGITAL VIDEO CAMERA  •3 COMPUTER  •4 AUDIO SENDER  •5 FM RADIO  •6 HEADPHONES  •7 RED LED  •8 WIRELESS CAMERA SOFTWARE:1. MACROMEDIA DIRECTOR MX Trackthemcolors Pro SetMouseXtra   2. SOUNDTRACK PRO 3. AUDACITY 4. GARAGEBAND