Abstract: Conversation-based context rules for altering virtual reality (VR) gaming and for switching between input languages based on heuristics related to past conversations between users.

Abstract: Consumer electronic devices have been developed with enormous information processing capabilities, high quality audio and video outputs, large amounts of memory, and may also include wired and/or wireless networking capabilities. Additionally, relatively unsophisticated and inexpensive sensors, such as microphones, video camera, GPS or other position sensors, when coupled with devices having these enhanced capabilities, can be used to detect subtle features about users and their environments. A variety of audio, video, simulation and user interface paradigms have been developed to utilize the enhanced capabilities of these devices. These paradigms can be used separately or together in any combination. One paradigm automatically creating user identities using speaker identification. Another paradigm includes a control button with 3-axis pressure sensitivity for use with game controllers and other input devices.

Abstract: Methods and systems for using a position of a mobile device with an integrated display as an input to a video game or other presentation are presented. Embodiments include rendering an avatar on a mobile device such that it appears to overlay a competing user in the real world. Using the mobile device's position, view direction, and the other user's mobile device position, an avatar (or vehicle, etc.) is depicted at an apparently inertially stabilized location of the other user's mobile device or body. Some embodiments may estimate the other user's head and body positions and angles and reflect them in the avatar's gestures.

Abstract: A method is provided, including: providing a first view of a virtual environment to a first HMD, the first view having a first view direction towards a virtual object, the first view being from a first-person perspective positioned at the first location; simultaneously, providing a second view to a second HMD, the second view being from a first-person perspective positioned at the first location, and rendering in the second view a virtual character associated to the first view, the rendering configured to present the virtual character as being positioned at a second location, and configured to present the virtual character having a second view direction adjusted relative to the first view direction so as to be from a first-person perspective of the virtual character as the virtual character is positioned at the second location, and so as to be towards the virtual object as shown in the second view.

Abstract: A system and method of adjusting content displayed to a user during an interactive HMD session to compensate for the user's head tilt. The user's head tilt causes the displayed content to be displayed offset from the user's comfortable viewing area of the screen in the HMD. The offset is determined a number of ways and then the displayed images are adjusted to reduce or substantially eliminate the offset. The adjusting can compensate for different user postures for standing, sitting, reclining, lying down, etc. as may occur during an interactive HMD session. The user's head tilt can be caused by the user's physical posture, physical shape or due to corrective lenses that cause the user to inadvertently tilt his head.

Abstract: A sensor generates signals representing whether a computer game headset is being worn properly so that the wearer may be advised. The sensor may be a pressure sensor or motion sensor or stretch sensor on the headset, or it may be a camera that images the wearer and uses image recognition to determine if the headset is on correctly.

Abstract: A glove for interfacing with a virtual reality scene presented via a head-mounted display (HMD) is provided. The glove includes a plurality of digits associated with the glove, each digit configured to receive a finger of a user of the glove; and, a plurality of sensors, each configured to identify a degree of flexion and being associated with one of a plurality of predefined locations along the plurality of digits, wherein one of the plurality of sensors at each of the predefined locations is selected as an optimal sensor for the respective predefined location.

Abstract: A method for assisting game play. The method includes monitoring game play of the user playing a gaming application, wherein the user has a defined task to accomplish, wherein the task is associated with a task type. The method includes determining a task type proficiency rule for the task type based on results of a plurality of players taking on a plurality of tasks having the task type. The method includes determining a player proficiency score for accomplishing the task based on the task type proficiency rule. The method includes determining a user predictive rate of success in accomplishing the task based on the player proficiency score, the task type proficiency rule, and the task. The method includes determining a recommendation for the user based on the user predictive rate of success.

Abstract: A method includes the following: presenting gameplay of a video game through a head-mounted display (HMD), the HMD being disposed in a local environment; detecting a person speaking in the local environment, wherein detecting the person speaking includes capturing audio from the local environment by the HMD, and analyzing the captured audio to identify the person speaking in the local environment; responsive to detecting the person speaking in the local environment, presenting a notification through the HMD, the notification providing an option to pause the gameplay of the video game; responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game and presenting through the HMD a view through an externally facing camera of the HMD that enables viewing of the person speaking in the local environment.

Abstract: Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.

Abstract: Methods and systems for using a position of a mobile device with an integrated display as an input to a video game or other presentation are presented. Embodiments include rendering an avatar on a mobile device such that it appears to overlay a competing user in the real world. Using the mobile device's position, view direction, and the other user's mobile device position, an avatar (or vehicle, etc.) is depicted at an apparently inertially stabilized location of the other user's mobile device or body. Some embodiments may estimate the other user's head and body positions and angles and reflect them in the avatar's gestures.

Abstract: A glove interface object is provided, comprising: a plurality of fluid channels disposed on a palmar side of the glove interface object, the fluid channels containing a magnetic fluid; a plurality of electromagnets positioned on the palmar side of the glove interface object, each of the plurality of electromagnets being configured when activated to generate a magnetic field that acts on at least a portion of the magnetic fluid; a controller configured to control activation and deactivation of the electromagnets based on received haptic feedback data.

Abstract: A system is provided, including: a peripheral device having a plurality of electromagnets; a glove interface object, the glove interface object having one or more magnetic sensors configured to sense magnetic fields generated by the electromagnets to determine a location of the glove interface object in an interactive environment, the glove interface object further having one or more inertial sensors configured to detect an orientation of the glove interface object.

Abstract: A system has a central processing unit (CPU) and a graphics processing unit (GPU) that includes one or more registers. The GPU can change a resource descriptor in one of the GPU's registers. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Abstract: A method is provided, including the following method operations: providing a first view of a virtual environment to a first head-mounted display (HMD), the first view being defined from a first location in the virtual environment, and associated to a first virtual character having a first view direction towards a virtual object in the virtual environment; simultaneous with the providing the first view, providing a second view of the virtual environment to a second HMD, the second view being defined from the first location in the virtual environment, and associated to a second virtual character in the virtual environment; wherein providing the second view includes rendering the first virtual character in the second view, the rendering of the first virtual character in the second view being configured to present the first virtual character as having a second location in the virtual environment, the rendering of the first virtual character in the second view being further configured to present the first virtual

Abstract: A method for rendering a virtual reality (VR) scene viewable via a head mounted display (HMD) is provided. The method includes detecting eye gaze of a user using one or more eye gaze sensors disposed in a display housing of the HMD. And, capturing images of a mouth of the user using one or more cameras disposed on the HMD, wherein the images of the mouth include movements of the mouth. Then, the method includes generating a virtual face of the user. The virtual face includes virtual eye movement obtained from the eye gaze of the user and virtual mouth movement obtained from said captured images of the mouth. The method includes presenting an avatar of the user in the VR scene with the virtual face. The avatar of the user is viewable by another user having access to view the VR scene from a perspective that enables viewing of the avatar having the virtual face of the user.

Abstract: A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. By allowing the spectator to move closer or further away from specific content, the spectators movement toward or away will cause an automatic scaling of content within the virtual-reality content being generated by an HMD player, that is sharing the content with the spectator. Other features include allowing a spectator to adjust the viewing angle of the content. The viewing angle of the content can be moved by allowing the spectator to reach into the content or control the content scene, and then position the content in the viewing angle that is most comfortable to the position of the spectator.

Abstract: A method for executing computer instructions for presenting an interactive environment in a head-mounted display (HMD) is described. The method includes identifying content associated with the interactive environment to be presented on the HMD for a user and determining whether an interactive object within the identified content satisfies a threshold for presentation to the user. The method includes augmenting the interactive object with augmentation data. The augmented data acts to change a characteristic of the interactive object. The operation of augmenting the interactive object is performed after determining that the interactive object does not satisfy the threshold for presentation to the user. The augmentation data modifies the interactive object to conform the interactive object to be within the threshold.

Abstract: A method for assisting game play. The method includes monitoring game play of the user playing a gaming application, wherein the user has a defined task to accomplish, wherein the task is associated with a task type. The method includes determining a task type proficiency rule for the task type based on results of a plurality of players taking on a plurality of tasks having the task type. The method includes determining a player proficiency score for accomplishing the task based on the task type proficiency rule. The method includes determining a user predictive rate of success in accomplishing the task based on the player proficiency score, the task type proficiency rule, and the task. The method includes determining a recommendation for the user based on the user predictive rate of success.

Abstract: Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.