Audio Visualization in 3 Different Patterns

This is a self-driven project in order to familiarize myself with the technique of coding and algorithm in vvvv. My concept was to visualize the sound by creating an audio-reactive animation. And I hope that people with hearing loss can therefore feel the beats of sounds by visual perception. In addition, I also hope that my work will bring people a new journey toward sounds through the process of perception, cognition, and interaction.

Date: September 3, 2021
Services: Animation
Tools: VVVV

Process

  • Choose 3 different kinds of music and ask 10 people to describe their feelings.
  • Define the geometric graphics according to the descriptions
  • Explore and research the possibilities of different modules in VVVV.
  • Create the ideal audio-reactive animations using the FFT node.

1. Press the play button, close your eyes and imagine…

Example 1:

Example 2:

Example 3:

( from Audio Library in YouTube )

2. Leave a note about your ideas!

(Example 1)
(Example 2)
(Example 3)

Result

It was an interesting and also surprising finding that most people have a very descriptive vision about what they heard. Even though the final result could not include all the ideas, I constructed the imageries of each music by combing most of the relative ideas. And I defined the kinds of music by giving each a name which are Rainy Day, New Life, and Party Night.

Experimenting with different patterns and animations, I successfully created three different types of patterns that ideally displayed the imageries. On the first pattern, I took the imagery of rain to represent the tear in one’s mind. However, I did not want to make it too heavy by using black and white color, so I made a hard decision on the color scheme and eventually chose the colors that are sad but also healing. On the second pattern, I used the Emitter node to fulfill the vision of new life, with the meaning literally and also the meaning of freeing yourself from the past.

Example 1. Rainy Day

Example 2. Free your Soul

Example 3. Party Night