Abstract: In some implementations, a method includes: obtaining user movement information, wherein the user movement information characterizes real-world body pose and trajectory information of the user; generating, from real-world user movement information and a predetermined placement of the virtual instrument in the computer generated reality (CGR) environment, a predicted virtual instrument interaction time for a virtual instrument interaction prior to the virtual instrument interaction occurring; determining whether or not the predicted virtual instrument interaction time falls within an acceptable temporal range around one of a plurality of temporal sound markers; and in response to determining that the predicted virtual instrument interaction time falls within the acceptable temporal range around a particular temporal sound marker of the plurality of temporal sound markers, quantizing the virtual instrument interaction by presenting play of the virtual instrument to match the particular temporal sound marker of

Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for implementing user interfaces for interacting with a virtual instrument. For example, a user interface for a virtual instrument may be presented on a display of a device. The user interface may have any suitable number of strings (or keys) associated with a physical instrument. Each string/key may correspond to an associated audio file. Touch input may be received at the user interface. In some embodiments, the touch input may include a location corresponding to a particular string. The associated audio file may be selected based on the location. The associated audio file may be presented (e.g., via a speaker of the device) at a volume that corresponds with the pressure at which the touch input was provided.

Abstract: Embodiments of the present disclosure can provide systems, methods, and computer-readable medium for implementing user interfaces for interacting with a virtual instrument. For example, a user interface for a virtual instrument may be presented on a display of a device. The user interface may have any suitable number of strings (or keys) associated with a physical instrument. Each string/key may correspond to an associated audio file. Touch input may be received at the user interface. In some embodiments, the touch input may include a location corresponding to a particular string. The associated audio file may be selected based on the location. The associated audio file may be presented (e.g., via a speaker of the device) at a volume that corresponds with the pressure at which the touch input was provided.

Abstract: Methods, computer program products, and systems for receiving gestures and producing percussion instrument signals are disclosed. An exemplary method includes receiving a gesture on an area of a touchscreen representing a percussion instrument and generating a signal based on the gesture and area. The gesture can be a single point initiation touch on an area, and a drag into another area. The gesture can be a two-touch point initiation touch on a first area, and a change in distance between the points to change a first parameter such as repeat rate. Such gestures can further include translation of the touch points as a group along an axis to change a second parameter such as volume, pitch, or reverb.

Abstract: Methods, computer program products, and systems for receiving gestures and producing percussion instrument signals are disclosed. An exemplary method includes receiving a gesture on an area of a touchscreen representing a percussion instrument and generating a signal based on the gesture and area. The gesture can be a single point initiation touch on an area, and a drag into another area. The gesture can be a two-touch point initiation touch on a first area, and a change in distance between the points to change a first parameter such as repeat rate. Such gestures can further include translation of the touch points as a group along an axis to change a second parameter such as volume, pitch, or reverb.