Project: Sonification of Rainforest Sensor Data I plan to create a software system for transforming sensor data from DINALAB’s LARA network into audio. I hope to collaborate with other scientists, artists and researchers to create audio that is communicates information from the sensor’s via sound. I am also interested in using this system purely to generate music.
My backup plan is to use local materials to build some bio-degradable sound sculptures.
Bio: I’m a musician, programmer and educator interested in interactive audio, sonification, acoustic ecology and bio-acoustics.
Relax and listen to Gregory Hanks Green play the Khaen a traditional Lao/Thai mouth organ made of bamboo pipes, as colors reveal the garden forms of the Thai forest. Curate the sound of the Khaen and the colors of the nocturnal garden by touching the tropical plants. Discover each note or song and color the touch triggers. Gregory Hanks Green, the curator of the Echols Collection of Southeast Asian music at the Cornell music library is also a Khaen player. Green can be heard in the Nocturnal Garden playing a song on the Khaen in the Lai Nyai mode or create your own Khaen song as you touch the leafy plants. Khaen is tradition Thai and Laotian free reed instrument that sounds when the player breathes in or out. A touch of the plants provokes a note on the khaen or a complete song played by Green as well as an array of twilight colors.
Collaborators: Artist Joan Marie Kelly and Senior Lecturer at Nanyang Technological University, curated the concept, and design of the touch sensor installation specifically for the natural environment of Koh Lon Thailand and the Digital naturalism conference 2018. Senior Technical Manager, animation at NTU in Singapore Nagaraju Thummanapalli coded the music and colored LED light to sensors, Musician Gregory Hanks Green contributed the digital files of himself playing the Khaen, flutist Beth Kelly was music consultant, and Tourism Ethnographer Yuthasak Chatkaewnapanon gave cultural council of the context of the artwork. Below are 2 short videos of the Nocturnal Garden.
At Dinacon 2018, Scott (Seamus) Kildallprototyped a new project called DinaSynth Quartet, whichis a live audio-synth performance between a plant, the soil, the air and the water in nature. This quadrophonic melange emits a synthetic soundscape that interacts with the buzz of cicadas, the croaks of frogs and the songs of the birds. By endowing hidden data in the natural environment with digital “voices,” the installation invites viewers into the jungle to experience digital artwork that almost always exists in the built environment.
My response to my time at Dinacon was to find a way to fuse the digital with the natural, seeking both a collaboration and future development around the idea of making chance orchestra arrangements. This experiment builds on my previous work, Sonaqua, which is an interactive installation that sonifies water quality.
These four “players” connect to sensors that modulate software synthesizers with embedded electronics. The plant uses electrodes, ground to soil sensor, water to electrical-conductivity sensor and air to humidity. Each one uses specific code that is active on one of my custom Sonaqua boards, and, each player has its own speaker so that you can spatialize the sound by walking around the outdoor installation space
The humidity reading varies the least and activates the a baseline, while the plant sounds like a skittering voice, as its voltage readings constantly shift around. The water has the high-pitched violin sound and the soil emits the melodic slow waves.
In future iterations, I will develop sculptural containers for these and improve the sound-synthesis. Ideally, they would play at various festivals or other outdoor spaces.