Abstract: Systems and methods are presented for immersive and simultaneous animation in a mixed reality environment. Techniques disclosed represent a physical object, present at a scene, in a 3D space of a virtual environment associated with the scene. A virtual element is posed relative to the representation of the physical object in the virtual environment. The virtual element is displayed to users from a perspective of each user in the virtual environment. Responsive to an interaction of one user with the virtual element, an edit command is generated and the pose of the virtual element is adjusted in the virtual environment according to the edit command. The display of the virtual element to the users is then updated according to the adjusted pose. When simultaneous and conflicting edit commands are generated by collaborating users, policies to reconcile the conflicting edit commands are disclosed.

Abstract: Systems and methods are presented for immersive and simultaneous animation in a mixed reality environment, Techniques disclosed represent a physical object, present at a scene, in a 3D space of a virtual environment associated with the scene. A virtual element is posed relative to the representation of the physical object in the virtual environment. The virtual element is displayed to users from a perspective of each user in the virtual environment. Responsive to an interaction of one user with the virtual element, an edit command is generated and the pose of the virtual element is adjusted in the virtual environment according to the edit command. The display of the virtual element to the users is then updated according to the adjusted pose. When simultaneous and conflicting edit commands are generated by collaborating users, policies to reconcile the conflicting edit commands are disclosed.

Abstract: The present disclosure relates generally to systems and methods for creating a mixed reality environment. A mixed reality system includes a performance area for generating a mixed reality environment, a motion determination module that determines and tracks the motion of an object within the performance area, a physical article module that generates a physical article within the performance area, and a mixed reality display that displays a virtual article within the performance area, wherein the physical article and the virtual article are correlated to the motion of the object.

Abstract: A system can be used in conjunction with a display configured to display an augmented reality (AR) environment including a virtual object placed in a real environment, the virtual object having a virtual location in the AR environment. The system includes a projector, a memory storing a software code, and a hardware processor configured to execute the software code to: determine a projector location of the projector in the real environment; generate a shadow projection in the real environment, the shadow projection corresponding to the virtual object and being based on the virtual location of the virtual object and the projector location; and project, using the projector, a light pattern in the real environment, the light pattern including a light projection and the shadow projection corresponding to the virtual object.

Abstract: There are provided systems and methods for synchronizing effects for multi-user mixed reality experiences. In one implementation, such a system includes a computing platform having a hardware processor and a system memory storing a software code. The hardware processor executes the software code to receive sensor data from multiple sensors within a venue, identify an activity in the venue based on the sensor data, and track a respective perspective and a respective location within the venue of each of multiple observers of the activity. The hardware processor also executes the software code to identify a first effect triggered by an action of one of the observers, conform the first effect to the respective perspective and the respective location of each of the observers to produce multiple second effects corresponding to the first effect, and output the second effects for operating multiple actuating devices within the venue during the activity.

Abstract: Systems and methods are presented for immersive and simultaneous animation in a mixed reality environment. Techniques disclosed represent a physical object, present at a scene, in a 3D space of a virtual environment associated with the scene. A virtual element is posed relative to the representation of the physical object in the virtual environment. The virtual element is displayed to users from a perspective of each user in the virtual environment. Responsive to an interaction of one user with the virtual element, an edit command is generated and the pose of the virtual element is adjusted in the virtual environment according to the edit command. The display of the virtual element to the users is then updated according to the adjusted pose. When simultaneous and conflicting edit commands are generated by collaborating users, policies to reconcile the conflicting edit commands are disclosed.

Abstract: The present disclosure relates generally to systems and methods for creating a mixed reality environment. A mixed reality system includes a performance area for generating a mixed reality environment, a motion determination module that determines and tracks the motion of an object within the performance area, a physical article module that generates a physical article within the performance area, and a mixed reality display that displays a virtual article within the performance area, wherein the physical article and the virtual article are correlated to the motion of the object.

Abstract: There are provided systems and methods for synchronizing effects for multi-user mixed reality experiences. In one implementation, such a system includes a computing platform having a hardware processor and a system memory storing a software code. The hardware processor executes the software code to receive sensor data from multiple sensors within a venue, identify an activity in the venue based on the sensor data, and track a respective perspective and a respective location within the venue of each of multiple observers of the activity. The hardware processor also executes the software code to identify a first effect triggered by an action of one of the observers, conform the first effect to the respective perspective and the respective location of each of the observers to produce multiple second effects corresponding to the first effect, and output the second effects for operating multiple actuating devices within the venue during the activity.