Something more happens when you make sounds with an electrical musical instrument. The analogue signal can be digitised and then, once its just numbers, those numbers can be used to do anything. Here I am manipulating video matrices again with “JITTER” in MAX.
There are some great objects in the “Jitter” library for splitting up and augmenting the colours and generally filtering the shit out of video matrices, in real time. I have tried to take things a step further and wrap the matrices onto GL objects and manipulate the objects shapes and movement with the sound signals. The physics environment is where the OpenGL shapes float around.