Abstract: A system and method of adjusting content displayed to a user during an interactive HMD session to compensate for the user's head tilt. The user's head tilt causes the displayed content to be displayed offset from the user's comfortable viewing area of the screen in the HMD. The offset is determined a number of ways and then the displayed images are adjusted to reduce or substantially eliminate the offset. The adjusting can compensate for different user postures for standing, sitting, reclining, lying down, etc. as may occur during an interactive HMD session. The user's head tilt can be caused by the user's physical posture, physical shape or due to corrective lenses that cause the user to inadvertently tilt his head.

Abstract: A glove for interfacing with a virtual reality scene presented via a head-mounted display (HMD) is provided. The glove includes a plurality of digits associated with the glove, each digit configured to receive a finger of a user of the glove; and, a plurality of sensors, each configured to identify a degree of flexion and being associated with one of a plurality of predefined locations along the plurality of digits, wherein one of the plurality of sensors at each of the predefined locations is selected as an optimal sensor for the respective predefined location.

Abstract: A method for assisting game play. The method includes monitoring game play of the user playing a gaming application, wherein the user has a defined task to accomplish, wherein the task is associated with a task type. The method includes determining a task type proficiency rule for the task type based on results of a plurality of players taking on a plurality of tasks having the task type. The method includes determining a player proficiency score for accomplishing the task based on the task type proficiency rule. The method includes determining a user predictive rate of success in accomplishing the task based on the player proficiency score, the task type proficiency rule, and the task. The method includes determining a recommendation for the user based on the user predictive rate of success.

Abstract: A method includes the following: presenting gameplay of a video game through a head-mounted display (HMD), the HMD being disposed in a local environment; detecting a person speaking in the local environment, wherein detecting the person speaking includes capturing audio from the local environment by the HMD, and analyzing the captured audio to identify the person speaking in the local environment; responsive to detecting the person speaking in the local environment, presenting a notification through the HMD, the notification providing an option to pause the gameplay of the video game; responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game and presenting through the HMD a view through an externally facing camera of the HMD that enables viewing of the person speaking in the local environment.

Abstract: Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.

Abstract: Methods and systems for using a position of a mobile device with an integrated display as an input to a video game or other presentation are presented. Embodiments include rendering an avatar on a mobile device such that it appears to overlay a competing user in the real world. Using the mobile device's position, view direction, and the other user's mobile device position, an avatar (or vehicle, etc.) is depicted at an apparently inertially stabilized location of the other user's mobile device or body. Some embodiments may estimate the other user's head and body positions and angles and reflect them in the avatar's gestures.

Abstract: A glove interface object is provided, comprising: a plurality of fluid channels disposed on a palmar side of the glove interface object, the fluid channels containing a magnetic fluid; a plurality of electromagnets positioned on the palmar side of the glove interface object, each of the plurality of electromagnets being configured when activated to generate a magnetic field that acts on at least a portion of the magnetic fluid; a controller configured to control activation and deactivation of the electromagnets based on received haptic feedback data.

Abstract: A system is provided, including: a peripheral device having a plurality of electromagnets; a glove interface object, the glove interface object having one or more magnetic sensors configured to sense magnetic fields generated by the electromagnets to determine a location of the glove interface object in an interactive environment, the glove interface object further having one or more inertial sensors configured to detect an orientation of the glove interface object.

Abstract: A system has a central processing unit (CPU) and a graphics processing unit (GPU) that includes one or more registers. The GPU can change a resource descriptor in one of the GPU's registers. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Abstract: A method is provided, including the following method operations: providing a first view of a virtual environment to a first head-mounted display (HMD), the first view being defined from a first location in the virtual environment, and associated to a first virtual character having a first view direction towards a virtual object in the virtual environment; simultaneous with the providing the first view, providing a second view of the virtual environment to a second HMD, the second view being defined from the first location in the virtual environment, and associated to a second virtual character in the virtual environment; wherein providing the second view includes rendering the first virtual character in the second view, the rendering of the first virtual character in the second view being configured to present the first virtual character as having a second location in the virtual environment, the rendering of the first virtual character in the second view being further configured to present the first virtual

Abstract: A method for rendering a virtual reality (VR) scene viewable via a head mounted display (HMD) is provided. The method includes detecting eye gaze of a user using one or more eye gaze sensors disposed in a display housing of the HMD. And, capturing images of a mouth of the user using one or more cameras disposed on the HMD, wherein the images of the mouth include movements of the mouth. Then, the method includes generating a virtual face of the user. The virtual face includes virtual eye movement obtained from the eye gaze of the user and virtual mouth movement obtained from said captured images of the mouth. The method includes presenting an avatar of the user in the VR scene with the virtual face. The avatar of the user is viewable by another user having access to view the VR scene from a perspective that enables viewing of the avatar having the virtual face of the user.

Abstract: A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. By allowing the spectator to move closer or further away from specific content, the spectators movement toward or away will cause an automatic scaling of content within the virtual-reality content being generated by an HMD player, that is sharing the content with the spectator. Other features include allowing a spectator to adjust the viewing angle of the content. The viewing angle of the content can be moved by allowing the spectator to reach into the content or control the content scene, and then position the content in the viewing angle that is most comfortable to the position of the spectator.

Abstract: A method for executing computer instructions for presenting an interactive environment in a head-mounted display (HMD) is described. The method includes identifying content associated with the interactive environment to be presented on the HMD for a user and determining whether an interactive object within the identified content satisfies a threshold for presentation to the user. The method includes augmenting the interactive object with augmentation data. The augmented data acts to change a characteristic of the interactive object. The operation of augmenting the interactive object is performed after determining that the interactive object does not satisfy the threshold for presentation to the user. The augmentation data modifies the interactive object to conform the interactive object to be within the threshold.

Abstract: A method for assisting game play. The method includes monitoring game play of the user playing a gaming application, wherein the user has a defined task to accomplish, wherein the task is associated with a task type. The method includes determining a task type proficiency rule for the task type based on results of a plurality of players taking on a plurality of tasks having the task type. The method includes determining a player proficiency score for accomplishing the task based on the task type proficiency rule. The method includes determining a user predictive rate of success in accomplishing the task based on the player proficiency score, the task type proficiency rule, and the task. The method includes determining a recommendation for the user based on the user predictive rate of success.

Abstract: Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.

Abstract: A method, system, computer readable media and cloud systems are provided for rendering virtual reality (VR) views into VR scenes for presentation to a head mounted display (HMD). One method includes sensing a position of a nose of the user when the HMD is worn by the user. The method includes identifying a model of the nose of the user based on the position that is sensed. The model of the nose having a dimension that is based on the position of the nose of the user, when the HMD is worn. The method further includes rendering images to a screen of the HMD to present the VR scenes. The images being augmented to include nose image data from the model of the nose. In one example, the HMD is configured to capture facial feature expressions which are usable to generate avatar faces of the user, and convey facial expressions and/or emotion.

Abstract: Methods, devices, and computer programs for controlling behavior of an electronic device are presented. A method includes an operation for operating the electronic device in a first mode of operation, and an operation for tracking the gaze of a user interfacing with the electronic device. The electronic device is maintained in a first mode of operation as long as the gaze is directed towards a predetermined target. In another operation, when the gaze is not detected to be directed towards the predetermined target, the electronic device is operated in a second mode of operation, which is different from the first mode of operation.

Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.

Abstract: Methods for observing a virtual reality environment of a virtual reality player is are provided. One method includes establishing, by a handheld device of an observer, a connection with a computer executing the virtual reality environment being presented to the virtual reality player using a head mounted display (HMD). Capturing, by a first camera of the handheld device, a current position of the virtual reality player in a real world space. Capturing, by a second camera of the handheld device, a face position of the observer. The face position being monitored to determine a viewing direction to a screen of the handheld device. The screen of the handheld device is configured to present the virtual reality environment and at least part of the virtual reality player interacting in the virtual reality environment.

Abstract: A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. By allowing the spectator to move closer or further away from specific content, the spectators movement toward or away will cause an automatic scaling of content within the virtual-reality content being generated by an HMD player, that is sharing the content with the spectator. Other features include allowing a spectator to adjust the viewing angle of the content. The viewing angle of the content can be moved by allowing the spectator to reach into the content or control the content scene, and then position the content in the viewing angle that is most comfortable to the position of the spectator.