Sammy Kamkar created an amazing sound reactive LED wall
This 4×4 wall has 1,728 addressable LEDs and tracks anyone in front of it via Kinect. Samy does smart background subtraction by creating a “depth window” in 3d space as the Kinect can provide me full depth data. The software is a combination of code he’s developed in OpenFrameworks, Syphon and Quartz Composer for sound reactivity. The panels are driven by a $19 micro-Teensy board using Direct Memory Access.
Andrew used a MSGEQ7chip to turn incoming audio and break it down into seven frequency bands. The data is sent to a Teensy 3.6 to control and assign colors to the LEDs lighting up the cubes. The result was an art installation that translated orchestra sounds into colors – blues purples for bass frequencies with higher frequencies in red. Each cube will also get brighter or dimmer depending on the volume level of the music.
This article gives a great overview of the project as well as instructions for building your own. Addtionally, all the code is available on GitHub.
Check out this video showing the LEDs in dancing action.
Some of the technical details ditigall11 provided on this project include:
5 Teensy’s running OctoWS2811 (Probably went a little overboard here, as I wanted the Teensy’s as close to the strips as possible, so I’m not using OctoWS2811 to its fullest, but I’m sure PJRC doesn’t mind :P)
Ableton Live/Max4Live/Jitter handling the music playing & video generation. Wrote a serial external for Max that basically generates a bytestream formatted for OctoWS2811 from a jit.matrix, so any video can be piped in realtime to the Teensy’s, with whatever fx/beat syncing is desired (Major props to nlecaude for the foundational work on this.)
Custom OSX app to monitor Twitter, queue up the requested songs, and update a tv display showing the song queue, available songs, and currently playing song.