At the core of the Lightspace Modulator process is a custom-designed visual instrument called VSx; a bespoke performance interface and graphics machine, built on game engine technology. Combined with Ableton Live (and seamlessly integrated through a proprietary bi-directional real time protocol) it’s a complete live visual and audio performance solution.
The tool is designed to be controlled with a touchscreen interface as well as MIDI instruments such as keyboards and drum triggers. It can also control electronic instruments — meaning that in any given performance musical cues might be driving visuals, or visual cues might be driving musical instruments, or both, simultaneously. As the system is geared towards live performance, gestures and triggers by the performer are always an essential component of the mix.
The main VSx interface allows the performer to assemble dynamic three-dimensional compositions of any level of complexity in a real time, improvisatory manner.
A suite of custom plugins for Ableton Live provide the link between the audio and visual engines (while VSx is also capable of audio output, for live music performance and production Ableton is a more robust instrument).
While first and foremost a live performance instrument, VSx can also be used for linear presentations and storytelling, following a pre-programmed timeline (of course real time adjustments to the narrative are always an option in such scenarios).
The video discussion in Assemblage and Dynamism provides a bit more background on the theory behind this system and process.