colour to sound
I made an experiment called colour to sound.
It (very unsurprisingly) takes colour data from the webcam video feed, and turns it into sound waves, using getUserMedia (to access the webcam), Canvas (to extract the color data from the video images), and then Web Audio (to generate sounds).
It sounds very simple, but actually there's been a lot of back and forth and a lot of false starts, which I alluded to in the project page, because I built this with the aim of simulating a hardware device which I have not seen in person and about which there is very little technical details published (or I have been unable to find them), only "hints" as to how it works that were detailed in interviews.
The hardware device is the Eyeborg or Cyborg antenna that a person called Neil Harbisson wears in his head. It is truly striking and I have so many questions about how it works—I will share my speculations about it some time soon.
In the meantime, go and play with my experiment!