Abstract: Methods and systems are provided for generating recommendations related to a game. One example method is for generating recommendations for a game executed by a cloud gaming service. The method includes receiving, by a server, sensor data captured during gameplay of the game by a plurality of user, and each of the plurality of sensor data includes intensity information related to reactions made by respective users. The method includes processing, by the server, features from the sensor data and the interactive data from the game when the users played the game. The features are classified and used to build an engagement model that identifies relationships between specific ones of the plurality of sensor data and the interactive data. The method includes processing, by the server, sensor data captured during a current gameplay by a user using the engagement model.

Abstract: A method is provided for refining calibration of a user input for a video game, including: performing an initial calibration process for a user input for the video game, wherein the initial calibration process determines calibration settings for the user input; initiating gameplay of the video game using the calibration settings determined from the initial calibration, such that the calibration settings are applied to interpret instances of the user input occurring during the gameplay; determining a game context in which the instances of the user input occur; analyzing the determined game context, and adjusting the calibration settings based on the analysis of the determined game context.

Abstract: A method is provided, including the following operations: receiving video of a first user; processing the video to identify signed communications in a first sign language made by the first user; translating the signed communications in the first sign language into signed communications in a second sign language; rendering an avatar of the user performing the translated signed communications in the second sign language; presenting the avatar on a display for viewing by a second user.

Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.

Abstract: Systems and methods for receiving a scene by a head mounted display (HMD) of an HMD user. One method includes receiving image data of a real world space where the HMD is located. The image data is analyzed to identify positional data on the one or more spectators present in the real world space. The method includes identifying, based on the positional data, that a personal space of a spectator is being encroached. The identifying causing an indicator to alert the HMD user of said encroachment of said personal space of the spectator.

Abstract: Methods and systems are provided for generating recommendations related to a game. One example method is for generating recommendations for a game executed by a cloud gaming service. The method includes receiving, by a server, sensor data captured during gameplay of the game by a plurality of user, and each of the plurality of sensor data includes intensity information related to reactions made by respective users. The method includes processing, by the server, features from the sensor data and the interactive data from the game when the users played the game. The features are classified and used to build an engagement model that identifies relationships between specific ones of the plurality of sensor data and the interactive data. The method includes processing, by the server, sensor data captured during a current gameplay by a user using the engagement model.

Abstract: Methods and systems describe augmenting image content presented on a mirror display. The method includes detecting images of a user in an activity volume in front of the mirror display; the detecting includes identifying a body of the user and tracking movements by the user while in the activity volume. The method includes receiving a request to predict a change in physique of the body of the user, the request includes input parameters that identify a physical exercise and an amount of said physical exercise. The method includes generating an augmented image of the body of the user; the augmented image of the body has said change in physique, the change in physique of the body is assembled from one or more three-dimensional (3D) models of one or more body parts of the body that have been adjusted in shape.

Abstract: Methods and systems are provided for processing feature similarity for a real-world space used for augmented reality (AR) gameplay is disclosed. The method includes receiving captured sensor data from the real-world space used by a user for said AR gameplay of a game. The sensor data provides data to identify characteristics of physical objects in the real-world space. The method includes generating a user space score using the characteristics of the physical objects identified in the real-world space. The method includes comparing the user space score to a game space score that is predefined for the game. The comparing is used to produce a fit handicap for the AR gameplay of the game in the real-world space by the user. Adjustments to gameplay parameters may be made to compensate or adjust the fit handicap.

Abstract: Methods for providing guidance to a user wearing a head mounted display (HMD) are provided. One example method includes using a camera of the HMD to track the user wearing the HMD in a real-world space, and identifying a safe zone within the real-world space for interacting with a virtual reality space via the HMD. The method further includes detecting movements of the user in the real-world space. The method includes integrating content into the virtual reality space. The content is configured to provide guidance in direction of movement of the user toward the safe zone of the real-world space. If the user continues to move away from safe zone, pausing presentation of the virtual reality space, and resuming the presentation when the user is in the safe zone.

Abstract: A method to identify positions of fingers of a hand is described. The method includes capturing images of a first hand using a plurality of cameras that are part of a wearable device. The wearable device is attached to a wrist of a second hand and the plurality of cameras of the wearable device is disposed around the wearable device. The method includes repeating capturing of additional images of the first hand, the images and the additional images captured to produce a stream of captured image data during a session of presenting the virtual environment in a head mounted display (HMD). The method includes sending the stream of captured image data to a computing device that is interfaced with the HMD. The computing device is configured to process the captured image data to identify changes in positions of the fingers of the first hand.

Abstract: A method is provided, including: tracking a location of a head-mounted display (HMD); tracking a gaze of a user of the HMD; generating video depicting a view of a virtual environment for the HMD based on the gaze of the user of the HMD; initiating wireless transmission of the video to the HMD for display on the HMD to the user, wherein initiating the wireless transmission includes setting a beamforming of a wireless transceiver towards the location of the head-mounted display; processing signal quality feedback received from the HMD to determine a quality of the wireless transmission; responsive to a loss in the quality of the wireless transmission, then adjusting the beamforming of the wireless transceiver.

Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.

Abstract: Methods and systems for determining a type of material of an object in a real-world environment are described. One of the methods includes receiving a plurality of sets of audio data based on sounds received from a plurality of objects within a plurality of environments. The method further includes receiving a plurality of sets of input data regarding a plurality of types of materials of the plurality of objects, training an artificial intelligence (AI) model based on the plurality of sets of audio data and the plurality of sets of input data, and applying the AI model to a set of audio data captured from the real-world environment to determine the type of material of the object within the real-world environment to enhance the realism of augmented reality (AR) or virtual reality (VR) video games and applications.

Abstract: Techniques are described for using the Advanced Television Systems Committee (ATSC) 3.0 television protocol to deliver volumetric information for presentation on various displays using ATSC over-the-air communications channels.

Abstract: Methods and systems are provided for processing feature similarity for a real-world space used for augmented reality (AR) gameplay is disclosed. The method includes receiving captured sensor data from the real-world space used by a user for said AR gameplay of a game. The sensor data provides data to identify characteristics of physical objects in the real-world space. The method includes generating a user space score using the characteristics of the physical objects identified in the real-world space. The method includes comparing the user space score to a game space score that is predefined for the game. The comparing is used to produce a fit handicap for the AR gameplay of the game in the real-world space by the user. Adjustments to gameplay parameters may be made to compensate or adjust the fit handicap.

Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.

Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.

Abstract: Methods and systems are provided for augmenting image content presented on a mirror display. The method includes detecting images of a user in an activity volume in front of the mirror display; the detecting includes identifying a body of the user and tracking movements by the user while in the activity volume. The method includes receiving a request to predict a change in physique of the body of the user, the request includes input parameters that identify a physical exercise and an amount of said physical exercise. The method includes generating an augmented image of the body of the user; the augmented image of the body has said change in physique, the change in physique of the body is assembled from one or more three-dimensional (3D) models of one or more body parts of the body that have been adjusted in shape.

Abstract: An AR system tracks a person's hand and an object being held in the hand. The manner in which the hand is gripping the object is correlated to a particular haptic signal that is implemented on the object.

Abstract: Techniques are described for using the Advanced Television Systems Committee (ATSC) 3.0 television protocol to deliver volumetric information for presentation on various displays using ATSC over-the-air communications channels.