Abstract: Systems and methods for determining predicted olfactory perception are provided. In particular, a method comprises receiving an input indicating an odorant, generating an odorant vector representing the odorant, generating an olfactory receptor vector, and determining one or more predicted olfactory percepts associated with the odorant based on the odorant vector and the olfactory receptor vector.

Abstract: A technique for providing multi-sensory content receives input information that expresses a physiological state and experienced emotional state of a user. The technique generates prompt information that describes at least an objective of guidance to be delivered and the input information. The technique maps the prompt information to output information using a pattern completion component. The output information contains control instructions for controlling an output system to deliver the guidance via generated content. In some implementations, the pattern completion component is a machine-trained pattern completion model. In some implementations, a reward-driven machine-trained model further processes the input information and/or the output information. The reward-driven machine-trained model is trained by reinforcement learning to promote the objective of the guidance. In other implementations, the reward-driven machine-trained model operates by itself, without the pattern completion component.

Abstract: Tactile virtual reality (VR) and/or mixed reality (MR) experiences are described. Techniques described herein include receiving data from a sensor and accessing a position and an orientation of a real object that is physically present in a real scene. Furthermore, techniques described herein include identifying the real object based at least in part on the position and the orientation of the real object and causing a graphical element corresponding to the real object to be rendered on a display of a VR and/or MR display device. The graphical element can be determined based at least in part on a VR and/or MR application. The techniques described herein include determining an interaction with the real object and causing a functionality associated with the graphical element to be performed in the VR or MR environment rendered via the VR and/or MR display device, respectively.

Abstract: Techniques described herein include mixed reality tools, referred to as HoloPaint, that allow use of any of a variety of sensors to determine physical parameters of real objects in a mixed reality environment. HoloPaint may correlate current measurements of the real world with past measurements to perform inventory management, analysis of changes of physical parameters of real objects and environments, and so on. A user may select which parameter to analyze by selecting a particular type of virtual paint, such as for drawing onto an object to be analyzed.

Abstract: Tactile virtual reality (VR) and/or mixed reality (MR) experiences are described. Techniques described herein include receiving data from a sensor and accessing a position and an orientation of a real object that is physically present in a real scene. Furthermore, techniques described herein include identifying the real object based at least in part on the position and the orientation of the real object and causing a graphical element corresponding to the real object to be rendered on a display of a VR and/or MR display device. The graphical element can be determined based at least in part on a VR and/or MR application. The techniques described herein include determining an interaction with the real object and causing a functionality associated with the graphical element to be performed in the VR or MR environment rendered via the VR and/or MR display device, respectively.

Abstract: Techniques described herein include mixed reality tools, referred to as HoloPaint, that allow use of any of a variety of sensors to determine physical parameters of real objects in a mixed reality environment. HoloPaint may correlate current measurements of the real world with past measurements to perform inventory management, analysis of changes of physical parameters of real objects and environments, and so on. A user may select which parameter to analyze by selecting a particular type of virtual paint, such as for drawing onto an object to be analyzed.

Abstract: Techniques described herein include mixed reality tools, referred to as HoloPaint, that allow one or more users to turn their physical environment into a painting and drawing canvas. In a mixed reality environment, the user is able to paint or draw in the air and/or on a surface. In a mixed reality environment, HoloPaint may allow the one or more users to paint in the air, mold and extract 3D meshes of surfaces, select among a number of various properties from the physical environment, spray and surface paint, splatter paint, and sculpt or shape digital content, among other things. Techniques described herein allow for simultaneous collaboration among mixed reality display devices of multiple users interacting with the graphical representations in the mixed reality environment.

Abstract: Tactile virtual reality (VR) and/or mixed reality (MR) experiences are described. Techniques described herein include receiving data from a sensor and accessing a position and an orientation of a real object that is physically present in a real scene. Furthermore, techniques described herein include identifying the real object based at least in part on the position and the orientation of the real object and causing a graphical element corresponding to the real object to be rendered on a display of a VR and/or MR display device. The graphical element can be determined based at least in part on a VR and/or MR application. The techniques described herein include determining an interaction with the real object and causing a functionality associated with the graphical element to be performed in the VR or MR environment rendered via the VR and/or MR display device, respectively.

Abstract: Tactile virtual reality (VR) and/or mixed reality (MR) experiences are described. Techniques described herein include receiving data from a sensor and accessing a position and an orientation of a real object that is physically present in a real scene. Furthermore, techniques described herein include identifying the real object based at least in part on the position and the orientation of the real object and causing a graphical element corresponding to the real object to be rendered on a display of a VR and/or MR display device. The graphical element can be determined based at least in part on a VR and/or MR application. The techniques described herein include determining an interaction with the real object and causing a functionality associated with the graphical element to be performed in the VR or MR environment rendered via the VR and/or MR display device, respectively.