Abstract: Embodiments include systems and methods for synthesizing, recording, performing and playing back visual music for virtual immersive video playback environments. Virtual music (VM) compositions can include 3D VM instruments, which can be controlled in a highly dynamic and expressive manner using human interface controllers. Some embodiments include novel techniques for controlling, synthesizing, and rendering VM instruments having complex particle system architectures. Some embodiments further provide VM compositional techniques built on four-dimensional modeling constructs that include path-adaptive coordinate systems that define a compositional space-time for modeling, and path-anchored object locators that place objects in the compositional space-time.

Abstract: Embodiments include systems and methods for synthesizing, recording, performing and playing back visual music for virtual immersive video playback environments. Virtual music (VM) compositions can include 3D VM instruments, which can be controlled in a highly dynamic and expressive manner using human interface controllers. Some embodiments include novel techniques for controlling, synthesizing, and rendering VM instruments having complex particle system architectures. Some embodiments further provide VM compositional techniques built on four-dimensional modeling constructs that include path-adaptive coordinate systems that define a compositional space-time for modeling, and path-anchored object locators that place objects in the compositional space-time.

Abstract: A hand-mounted controller is provided that allows a user to manipulate individual sensors associated with one or more, and typically each, of a wearer's fingers and thumb while monitoring movement of the controller in three dimensional space. The controller includes a palm grip that may be affixed to the hand via straps. Attached to the palm grip is one or more finger actuated controls and one or more thumb actuated controls. A position sensor detects the position and orientation of the hand. The palm grip is contoured to distribute pressure across the carpals and the four finger metacarpals, while providing clearance so as not to interfere with the finger metacarpophalangeal joints and/or the thumb carpometacarpal joint.

Abstract: A hand-mounted controller is provided that allows a user to manipulate individual sensors associated with one or more, and typically each, of a wearer's fingers and thumb while monitoring movement of the controller in three dimensional space. The controller includes a palm grip that may be affixed to the hand via straps. Attached to the palm grip is one or more finger actuated controls and one or more thumb actuated controls. A position sensor detects the position and orientation of the hand. The palm grip is contoured to distribute pressure across the carpals and the four finger metacarpals, while providing clearance so as not to interfere with the finger metacarpophalangeal joints and/or the thumb carpometacarpal joint.