Abstract: Player-to-player eye contact is used to establish a private chat channel in an augmented reality (AR) or virtual reality (VR) setting. Since maintaining eye contact requires agreement from both parties, it allows both players an equal amount of control when performing the mutual action. Eye tracking may be used for determining whether mutual eye contact has been established. In the case of AR, “inside out” eye tracking can be used, whereas in a VR setting only inside eye tracking need be used. Techniques are described to confirm and establish a channel once eye contact has been held.

Abstract: A method for updating information for a graphics pipeline including executing in the first frame period an application on a CPU to generate primitives of a scene for a first video frame. Gaze tracking information is received in a second frame period for an eye of a user. In the second frame period a landing point on an HMD display is predicted at the CPU based at least on the gaze tracking information. A late update of the predicted landing point to a buffer accessible by the GPU is performed in the second frame period. Shader operations are performed in the GPU in the second frame period to generate pixel data based on the primitives and based on the predicted landing point, wherein the pixel data is stored into a frame buffer. The pixel data is scanned out in the third frame period from the frame buffer to the HMD.

Abstract: Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

Abstract: Image data from two different devices is used to identify a physical interaction between two users to authenticate a digital interaction between the users.

Abstract: A method is provided, including: recording gameplay data from a first session of a video game, the first session defined for interactive gameplay of a user; training a machine learning model using the gameplay data, wherein the training causes the machine learning model to imitate the interactive gameplay of the user; after the training, determining a classification of the machine learning model by exposing the machine learning model to one or more scenarios of the video game, and evaluating actions of the machine learning model in response to the one or more scenarios; and, using the classification of the machine learning model to provide a coaching recommendation to the user.

Abstract: Force feedback is applied to a computer simulation controller, such as to a joystick element or analog trigger of the controller, depending on the context of the simulation.

Abstract: A method is provided, including the following operations: recording gameplay data from a first session of a video game, the first session defined for interactive gameplay of a user; training a machine learning model using the gameplay data, wherein the training causes the machine learning model to imitate the interactive gameplay of the user; after the training, determining a classification of the machine learning model by exposing the machine learning model to one or more scenarios of the video game, and evaluating actions of the machine learning model in response to the one or more scenarios; using the classification of the machine learning model to assign the user to a second session of the video game.

Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

Abstract: Force feedback is applied to a computer simulation controller, such as to a joystick element or analog trigger of the controller, depending on the context of the simulation.

Abstract: Methods and systems are provided for generating animation for non-player characters (NPCs) in a game. The method includes operations for examining a scene for an NPC that is providing voice output. The method further includes operations for examining the voice output to identify am intensity modulation of the voice output. In addition, the method further includes processing the intensity modulation to predict body language signals (BLS) for the NPC. Moreover, the BLS is used to cause features of the NPC to react consistent with an emotion content of the intensity modulation identified in the voice output.

Abstract: Gamer friend devices can be detected by a gaming console and the gaming console user can be prompted to add the friend devices to a friend list, which automatically logs the friends on to the console without requiring them to manually log in. The gaming console may also be automatically configured with profile information of the friends.

Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

Abstract: Gamer friend devices can be detected by a gaming console and the gaming console user can be prompted to add the friend devices to a friend list, which automatically logs the friends on its the console without requiring them to manually log in. The gaming console may also be automatically configured with profile information of the friends.

Abstract: Methods and systems for using a robot to interact in a social media includes receiving a request for registering the robot in the social media from a user. In response to the request, user profile of the user is retrieved. The user profile of the user identifies privileges assigned to the user for interacting in the social media. The robot is paired to the user account of the user by generating a second user account for the robot in the social media and assigning, to the robot, a subset of the privileges associated with the user account. The privileges allow the robot to access the social interactions available in the user account and to generate social interactions on behalf of the user, which are then posted to the social media for the user.

Abstract: Player-to-player eye contact is used to establish a private chat channel in an augmented reality (AR) or virtual reality (VR) setting. Since maintaining eye contact requires agreement from both parties, it allows both players an equal amount of control when performing the mutual action. Eye tracking may be used for determining whether mutual eye contact has been established. In the case of AR, “inside out” eye tracking can be used, whereas in a VR setting only inside eye tracking need be used. Techniques are described to confirm and establish a channel once eye contact has been held.

Abstract: A method for training a character for a game is described. The method includes facilitating a display of one or more scenes of the game. The one or more scenes include the character and virtual objects. The method further includes receiving input data for controlling the character by a user to interact with the virtual objects and analyzing the input data to identify interaction patterns for the character in the one or more scenes. The interaction patterns define inputs to train an artificial intelligence (AI) model associated with a user account of the user. The method includes enabling the character to interact with a new scene based on the AI model. The method includes tracking the interaction with the new scene by the character to perform additional training of the AI model.

Abstract: A method is provided, including the following operations: recording gameplay data from a first session of a video game, the first session defined for interactive gameplay of a user; training a machine learning model using the gameplay data, wherein the training causes the machine learning model to imitate the interactive gameplay of the user; after the training, determining a classification of the machine learning model by exposing the machine learning model to one or more scenarios of the video game, and evaluating actions of the machine learning model in response to the one or more scenarios; using the classification of the machine learning model to assign the user to a second session of the video game.

Abstract: A warning is generated when a computer simulation controller is determined to have insufficient charge to permit use through an upcoming simulation sequence. Thus, responsive to a computer simulation having a first context and a computer simulation controller having a first voltage, a human-perceptible indication of low voltage is presented, whereas if the computer simulation has a second context typically requiring less input than the first context, no indication is presented if the controller has the same first voltage.

Abstract: Force feedback is applied to a computer simulation controller, such as to a joystick element or analog trigger of the controller, depending on the context of the simulation.

Abstract: A computer controller when in a normal orientation causes a first context of simulation play to be implemented. When inverted, the controller causes a second, different context of simulation play to be implemented.