This project began as an experiment in setting up communication between Unreal Engine and Ableton Live. I had been working on a live performance setup in Ableton that was structured around the idea of dub mixing, manipulating individual tracks of a song live.
For the visuals, my goal was to create a link between Ableton and Unreal that was as reactive as possible.
I reached out to my friend Sem Schreuder, who created custom Max/MSP patches that allowed me to send midi messages and audio amplitude data to Unreal using OSC, and set up the blueprint code in Unreal for parsing and transmitting the data to individual objects in the 3D environment.