Nuance is a multi-track recording software created to capture synchronous multimodal, heterogeneous, data-streams. Essentially, Nuance is like a traditional DAW; however, not only can it record audio, but it can also record data via MIDI, OSC (Open Sound Control), and Serial data streams (such as custom arduino-based controllers). This makes it possible to record performance and gesture data from nearly any instrument, hyperinstrument, interface, or sensor system. All data is recorded as uncompressed .wav files, allowing sensor and gesture data to be analyzed similarly as regular audio recordings.
Nuance was developed and used extensively in my Ph.D research over the last couple of years. Research projects facilitated by Nuance ranged investigated performance metrics, music information retrieval, and macine learning. Examples include Performer Recognition, Drum-hand Recognition, Multimodal Onset Detection, and Short and long-term performance metrics tracking.
A full paper on the capabilities of Nuance will be presented at ICMC (the International Computer Music Conference) this September in Slovenia, but for now, check out the following screencast showing Nuance in action. For those interested, the paper will be uploaded after the conference, followed by a download (and source) of the actual software.
