Sonify

Sonify was the project I developed for my undergraduate and Master's projects at Stony Brook University. It's an audio application where users interact with a virtual space by dragging and drawing, which ends up effecting different audio tracks with a variety of effects, in real time. I developed a novel algorithm, based on acoustic properties like reflection and attenuation, that converts the objects in the space to a full audio mix. Here is the poster for the presentation I gave on the project at the end of undergrad.

During the Master's portion of the work, I conducted two usability studies and wrote a paper on the concept, implementation, and study results, which now lives on arXiv (the project is referred to as "Sonispace" in the paper for a less generic name).

I made this video for the usability experiment, but it serves as a decent overview of the app's features.