Abstract: A system for creating music using visual input. The system detects events and metrics (e.g., objects, gestures, etc.) in user input (e.g., video, audio, music data, touch, motion, etc.) and generates music and visual effects that are synchronized with the detected events and correspond to the detected metrics. To generate the music, the system selects parts from a library of stored music data and assigns each part to the detected events and metrics (e.g., using heuristics to match musical attributes to visual attributes in the user input). To generate the visual effects, the system applies rules (e.g., that map musical attributes to visual attributes) to translate the generated music data to visual effects. Because the visual effects are generated using music data that is generated using the detected events/metrics, both the generated music and the visual effects are synchronized with—and correspond to—the user input.

Abstract: An ergonomic, portable, electronic, string-like instrument that utilizes a string-like interface. The string-like interface is tactile for sightless playability and capable of advanced input such as force and pressure sensitivity. The string-like interface functions to select a note, trigger a selected note, select and play a note on the instrument or an external peripheral. The instrument is played using the techniques of multiple stringed instruments and the ergonomics allow the user to hold and handle the device consistent with playing techniques familiar to musicians of multiple instruments. It is internally or externally powered and connects directly to industry-standard musical hardware such as MIDI devices, amplifiers and multi-track recorders.

Abstract: An ergonomic, portable, electronic, string-like instrument that utilizes a pseudo-string interface. The pseudo-string interface is tactile for sightless playability and capable of advanced input such as force and pressure sensitivity. The pseudo-strings function to select a note, trigger a selected note, select and play a note on the instrument or an external peripheral. The instrument is played using the techniques of multiple other stringed instruments and the ergonomics allow the user to hold and handle the device consistent with traditional and non-traditional playing techniques familiar to musicians of various instruments. It is internally or externally powered and connects directly to industry-standard musical hardware such as MIDI devices, amplifiers and multi-track recorders.