Re: Perception
Re: Perception is a software project and gallery installation which explores the boundaries between sight and sound. It is a system to visualize music as images and playback images as songs. One station analyzes audio input and encodes that data into the color values of a PNG image. The resultant image becomes a medium to store and view audio information. The second station offers a method to playback images by shifting pixel color values back into audio frequencies. Thus, the image can be perceived sonically as well as visually.
The above video is a software demo showing the audio to image conversion interface. The audio input (classical music) is analyzed using and FFT algorithm to reduce the input into its three loudest frequencies, which are then stored as HSB color values in a PNG image. Both the input audio and the FFT analysis results can be heard simultaneously.
This video demonstrates the image to audio conversion interface for Re: Perception. Audio data that was previously saved into a PNG image is played back as three oscillator frequencies. No live audio input is used, only data retrieved from the image’s HSB color values is used to reconstruct a simplified version of the recorded audio input.
Example “song-images” created with the Re: Perception software.
0 comments:
Post a Comment