Abstract: Systems and methods are presented for immersive and simultaneous animation in a mixed reality environment. Techniques disclosed represent a physical object, present at a scene, in a 3D space of a virtual environment associated with the scene. A virtual element is posed relative to the representation of the physical object in the virtual environment. The virtual element is displayed to users from a perspective of each user in the virtual environment. Responsive to an interaction of one user with the virtual element, an edit command is generated and the pose of the virtual element is adjusted in the virtual environment according to the edit command. The display of the virtual element to the users is then updated according to the adjusted pose. When simultaneous and conflicting edit commands are generated by collaborating users, policies to reconcile the conflicting edit commands are disclosed.

Abstract: A method, computer program product, and system for receiving an object descriptor from a user. The object descriptor is processed to associate the object descriptor with one of a plurality of synthetic objects, thus defining an associated synthetic object. At least a portion of a synthetic three-dimensional environment is scanned for the existence of the associated synthetic object. Feedback is provided to the user concerning the existence of the associated synthetic object within the synthetic three-dimensional environment.