Sound-reactive Kinect tracking LED wall

Sammy Kamkar created an amazing sound reactive LED wall

This 4×4 wall has 1,728 addressable LEDs and tracks anyone in front of it via Kinect. Samy does smart background subtraction by creating a “depth window” in 3d space as the Kinect can provide me full depth data. The software is a combination of code he’s developed in OpenFrameworks, Syphon and Quartz Composer for sound reactivity. The panels are driven by a $19 micro-Teensy board using Direct Memory Access.

Symphony Hack Lab Light Cubes

Andrew Pelling and the pHacktory recently made beautiful light cubes as part of Hack the Symphony with the National Arts Centre Orchastra.

This video posted on Twitter shows the testing of the cubes prior to the performance.

Andrew used a MSGEQ7chip to turn incoming audio and break it down into seven frequency bands.  The data is sent to a Teensy 3.6 to control and assign colors to the LEDs lighting up the cubes.  The result was an art installation that translated orchestra sounds into colors – blues purples for bass frequencies with higher frequencies in red.  Each cube will also get brighter or dimmer depending on the volume level of the music.

This article gives a great overview of the project as well as instructions for building your own.  Addtionally, all the code is available on GitHub.

You can read more about the project and Andrew over on artsfile.



Twitter Taxi

Forum User digital11 outfitted a 1922 Checker Cab with Ws2811 LEDs that react to music that can be requested over Twitter.

Check out this video showing the LEDs in dancing action.

Some of the technical details ditigall11 provided on this project include:

5 Teensy’s running OctoWS2811 (Probably went a little overboard here, as I wanted the Teensy’s as close to the strips as possible, so I’m not using OctoWS2811 to its fullest, but I’m sure PJRC doesn’t mind :P)

Ableton Live/Max4Live/Jitter handling the music playing & video generation. Wrote a serial external for Max that basically generates a bytestream formatted for OctoWS2811 from a jit.matrix, so any video can be piped in realtime to the Teensy’s, with whatever fx/beat syncing is desired (Major props to nlecaude for the foundational work on this.)

Custom OSX app to monitor Twitter, queue up the requested songs, and update a tv display showing the song queue, available songs, and currently playing song.