Abstract: A method for gaming. The method includes assigning a default game play profile to a user, wherein the default game play profile includes a default game play style that simulates human game play, and wherein the default game play profile is configured to control game play for the user based on the default game play style. The method includes monitoring a plurality of game plays of the user playing a plurality of gaming applications. The method includes generating a user game play profile of the user by adjusting the default game play style based on the plurality of game plays, wherein the user game play profile incudes a user game play style customized to the user. The method includes controlling an instance of a first gaming application based on the user game play style of the user game play profile.

Abstract: Methods for simulating a source of sound are provided. One method includes determining, by a computer, a location in physical space of a head of a user. The location is determined by capturing images by a camera of the physical space in which a user is located. The method further includes determining a sound for delivery to two speakers worn by the user and determining, by the computer, an emanating location in the physical space for the sound. The method further includes establishing, by the computer, acoustic signals for each speaker based on the location in the physical space of the head, the sound, the emanating location in the physical space, and a selected auditory characteristics of the user. The auditory characteristics of the user are identified based on a calibration process. The method further includes transmitting, by the computer, the acoustic signals to the two speakers. The acoustic signals simulate that the sound originated at the emanating location in space.

Abstract: Metadata indicating demanded haptic events during playback of an audio video (AV) stream is embedded with the AV stream, such that the metadata can be extracted during AV playback and rendered on the player's side as demanded. In this way, previously recorded video can be spectated during playback without losing whatever haptic experiences may have been generated for original playback without having to rely on merely deriving haptic events from audio.

Abstract: A method for reducing latency in execution of a game is described. The method includes receiving via a computer network a user input associated with the game and determining from the user input a current state of the game. While the current state of the game is being determined, the method includes predicting a next state of the game based on the user input and one or more predicted user inputs. The method further includes generating one or more predicted image frames from the next state, determining whether the one or more predicted user inputs are received via the computer network, and sending the one or more predicted image frames in response to receiving the one or more predicted user inputs to reduce the latency in execution of the game.

Abstract: Methods and systems for spectating a live video game are presented. In one embodiment, a method for performing an automated catch-up to a player is provided. The method includes providing an interface for presenting a first view of a video game on a client device where the first view has a first vantage point and includes a target player. The method includes an operation for providing a portal within the interface for presenting a second view of the target object, the second view having a second vantage point. The method further includes an operation for moving the second vantage point toward the target object within the portal. Additionally, the method provides an operation for wiping away the portal.

Abstract: Metadata indicating demanded haptic events during playback of an audio video (AV) stream is embedded with the AV stream, such that the metadata can be extracted during AV playback and rendered on the player's side as demanded. In this way, previously recorded video can be spectated during playback without losing whatever haptic experiences may have been generated for original playback without having to rely on merely deriving haptic events from audio.

Abstract: A method for gaming. The method includes assigning a default game play profile to a user, wherein the default game play profile includes a default game play style that simulates human game play, and wherein the default game play profile is configured to control game play for the user based on the default game play style. The method includes monitoring a plurality of game plays of the user playing a plurality of gaming applications. The method includes generating a user game play profile of the user by adjusting the default game play style based on the plurality of game plays, wherein the user game play profile includes a user game play style customized to the user. The method includes controlling an instance of a first gaming application based on the user game play style of the user game play profile.

Abstract: A method is provided, including the following: presenting gameplay of a video game through a head-mounted display, the head-mounted display being disposed in a local environment; capturing audio from the local environment, and analyzing the captured audio to detect a person speaking in the local environment; responsive to detecting the person speaking in the local environment, presenting a notification through the head-mounted display, the notification providing an option which pauses the gameplay of the video game; responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game.

Abstract: A method for assisting game play. The method includes monitoring game play of the user playing a gaming application, wherein the user has a defined task to accomplish, wherein the task is associated with a task type. The method includes determining a task type proficiency rule for the task type based on results of a plurality of players taking on a plurality of tasks having the task type. The method includes determining a player proficiency score for accomplishing the task based on the task type proficiency rule. The method includes determining a user predictive rate of success in accomplishing the task based on the player proficiency score, the task type proficiency rule, and the task. The method includes determining a recommendation for the user based on the user predictive rate of success.

Abstract: Methods for observing a virtual reality environment of a virtual reality player is are provided. One method includes establishing, by a handheld device of an observer, a connection with a computer executing the virtual reality environment being presented to the virtual reality player using a head mounted display (HMD). Capturing, by a first camera of the handheld device, a current position of the virtual reality player in a real world space. Capturing, by a second camera of the handheld device, a face position of the observer. The face position being monitored to determine a viewing direction to a screen of the handheld device. The screen of the handheld device is configured to present the virtual reality environment and at least part of the virtual reality player interacting in the virtual reality environment.

Abstract: In one implementation, a portable device is provided, including: a sensor configured to generate sensor data for determining and tracking a position and orientation of the portable device during an interactive session of a virtual reality program presented on a main display, the interactive session being defined for interactivity between a user and the virtual reality program; a communications module configured to send the sensor data to a computing device, the communications module being further configured to receive from the computing device an ancillary video stream of the interactive session that is generated based on a state of the virtual reality program and the tracked position and orientation of the portable device.

Abstract: A method is provided, including: providing a first view of a virtual environment to a first HMD, the first view having a first view direction towards a virtual object, the first view being from a first-person perspective positioned at the first location; simultaneously, providing a second view to a second HMD, the second view being from a first-person perspective positioned at the first location, and rendering in the second view a virtual character associated to the first view, the rendering configured to present the virtual character as being positioned at a second location, and configured to present the virtual character having a second view direction adjusted relative to the first view direction so as to be from a first-person perspective of the virtual character as the virtual character is positioned at the second location, and so as to be towards the virtual object as shown in the second view.

Abstract: A sensor generates signals representing whether a computer game headset is being worn properly so that the wearer may be advised. The sensor may be a pressure sensor or motion sensor or stretch sensor on the headset, or it may be a camera that images the wearer and uses image recognition to determine if the headset is on correctly.

Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.

Abstract: A method for reducing latency in execution of a game is described. The method includes receiving via a computer network a user input associated with the game and determining from the user input a current state of the game. While the current state of the game is being determined, the method includes predicting a next state of the game based on the user input and one or more predicted user inputs. The method further includes generating one or more predicted image frames from the next state, determining whether the one or more predicted user inputs are received via the computer network, and sending the one or more predicted image frames in response to receiving the one or more predicted user inputs to reduce the latency in execution of the game.

Abstract: A method is provided, including the following operations: presenting on a display device a virtual scene including a virtual character, the display device disposed in a local environment; providing a view of the local environment through a head-mounted display, the view through the head-mounted display including the display device and the virtual scene being presented thereon; animating the virtual character to show the virtual character moving from the virtual scene presented on the display device to the local environment as viewed through the head-mounted display, wherein the animating includes transitioning, from rendering the virtual character as part of the virtual scene presented on the display device, to rendering the virtual character as an augmented element in the view of the local environment provided through the head-mounted display.

Abstract: Methods and systems for spectating a live video game are presented. In one embodiment, a method for performing an automated catch-up to a player is provided. The method includes providing an interface for presenting a first view of a video game on a client device where the first view has a first vantage point and includes a target player. The method includes an operation for providing a portal within the interface for presenting a second view of the target object, the second view having a second vantage point. The method further includes an operation for moving the second vantage point toward the target object within the portal. Additionally, the method provides an operation for wiping away the portal.

Abstract: Methods and systems for spectating a live video game are presented. In one method embodiment, an operation includes providing an interface for presenting an overhead view of an interactive environment of a video game on a head mounted display (HMD). The method also provides an operation for providing a magnifying window for displaying a magnified view of the interactive environment, where the magnified view is associated with a second vantage point that is closer to the interactive environment than is a first vantage point of the overhead view. The method further provides an operation for tracking a real-world position of a controller of the spectator and moving the location of the magnifying window to correspond to the real-world position of the controller.

Abstract: A method is provided, including: receiving captured images of an interactive environment in which a head-mounted display (HMD) is disposed; receiving inertial data processed from at least one inertial sensor of the HMD; analyzing the captured images of the interactive environment and the inertial data to determine a predicted future location of the HMD; using the predicted future location of the HMD to adjust a beamforming direction of an RF transceiver in a direction that is towards the predicted future location of the HMD; tracking a gaze of a user of the HMD; predicting a movement of the gaze of the user; generating video depicting a view of a virtual environment for the HMD; wherein the regions of the view are rendered differently based on the predicted movement of the gaze of the user; wirelessly transmitting the video via the RF transceiver to the HMD using the adjusted beamforming direction.

Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.