Abstract: A method and system for providing gaze-based generation of virtual effects indicators correlated with directional sounds is disclosed. Gaze data is tracked via a camera associated with a client device to identify a point of focus within a three-dimensional virtual environment towards which one or both eyes of the player are focused. When the point of focus indicated by the gaze data when the point of focus does not move towards the source location within the three-dimensional virtual environment when the directional sound is received indicates that a virtual effect indicator associated with the directional sound type of the indicated directional sound is should be generated.

Abstract: Methods and systems are provided for rendering assistive chat during play of a video game. An example method includes tracking a gaze of a first player interacting with a scene of an environment of the video game. The method includes identifying a gaze focus of the first player. The gaze focus is toward a character in the scene. The character is associated with a second player. The method includes processing state data of the environment to identify an event occurring in the environment of the video game. The method includes surfacing an indicator to the first player that is suggestive of participating in a chat communication with the second player. The surfacing is configured to be triggered responsive to the gaze focus being toward the character and the identified event.

Abstract: A system that teaches players gestures, for instance during the introduction of the game, and asks the player to invoke the gesture. Rather than asking the player to repeat over and over until the player succeeds, the game looks for commonality in the player's attempts, and after a small number of attempts, the game can learn how that player interprets the gesture given the player's own ability. The game can then adapt itself to look for that pattern to trigger the action.

Abstract: A method for managing gameplay of a video game is provided, including: executing a session of a video game by a cloud gaming resource; streaming video generated by the session over a network to a client device associated to a player of the video game, to enable gameplay of the session by the player; detecting a loss of network connectivity between the client device and the session; responsive to detecting the loss of network connectivity, then initiating transmission of updates regarding the session, via an alternative communication channel, to a secondary device associated to the player.

Abstract: A method for providing an auto-play mode option to a user during gameplay of a video game includes accessing, by a server, a user play model, which incorporates extracted features related to gameplay by the user and classification of the extracted features. The accessing of the model is triggered at a current time during gameplay. The method also includes identifying, by the server, predicted interactive activity that is predicted to occur ahead of the current time of gameplay. The method further includes identifying, by the server, at least part of the predicted interactive activity to be anticipated grinding content (AGC). The method also includes providing a notification, by the server, to a display screen of a user device, where the notification identifies the AGC in upcoming gameplay and provides the user with an option to use the auto-play mode during gameplay of the AGC.

Abstract: To help a computer game player in understanding a computer game, upon pausing the game, visual subtitles may be presented. In addition, or alternatively, Braille representing subtitles may be output as a series of vibrations on a touch pad of the controller. When the person's finger reaches the edge of the touch pad, a new series of Braille subtitles may be presented. Depending on where the player is in reading the subtitles and how fast the player reads them, the game video may be slowed down from normal speed.

Abstract: Techniques are described for smooth switchover of computer game control. The current states of game input is communicated to a new player assuming control. The new player is allowed time to catch up to the game. New player control is detected, and any errors are communicated to the new player. If there are differences between the old control scheme and that of the new player, they are reconciled. The outgoing player is adjusted to the transition.

Abstract: To improve the fidelity of a motion sensor, voice-induced components in signals from the motion sensor as well as haptic-induced components in signals from the motion sensor are canceled prior to outputting the final motion signal to an app requiring knowledge of device motion, such as motion of a HMD for a computer game.

Abstract: To protect a user's privacy by reducing a malicious developer's ability to eavesdrop on unwitting HMD users by converting signals from a motion sensor in the HMD to speech or speaker recognition, a microphone can record ambient sound and voice which is subtracted from the motion sensor data before the sensor data is made available to the game developer. Additionally, ANC (active noise cancellation) techniques can be adapted to cancel noise from a motion sensor's data. In another technique, a band pass filter subtracts frequency in the sensor signals within the voice range. Still a third technique blends statistical noise into the motion sensor signal before passing to game developers to obfuscate the user's speech.

Abstract: To protect a user's privacy by reducing a malicious developer's ability to eavesdrop on unwitting HMD users by converting signals from a motion sensor in the HMD to speech or speaker recognition, a microphone can record ambient sound and voice which is subtracted from the motion sensor data before the sensor data is made available to the game developer. In another technique, a band pass filter subtracts frequency in the sensor signals within the voice range. Still a third technique blends statistical noise into the motion sensor signal before passing to game developers to obfuscate the user's speech. The amount by which voice components in the motion signal are eliminated or obfuscated can be tuned by a person or app.

Abstract: A system that teaches players gestures, for instance during the introduction of the game, and asks the player to invoke the gesture. Rather than asking the player to repeat over and over until the player succeeds, the game looks for commonality in the player's attempts, and after a small number of attempts, the game can learn how that player interprets the gesture given the player's own ability. The game can then adapt itself to look for that pattern to trigger the action.

Abstract: A player who is interrupted during play of a computer simulation such as a computer game and must attend to other matters (colloquially referred to herein as being “away from keyboard” or “AFK”) is assisted in three phases. A first type of assistance is rendered when entering AFK, as in, at the start of the interruption. A second type of assistance is rendered during AFK, while the player is away. A third type of assistance is rendered when the player returns from AFK to the computer simulation.

Abstract: Privacy of a conversation between a computer game player and an entity such as a person or virtual assistant is preserved by various techniques so that other players of the computer game who are not part of the conversation cannot apprehend the conversation. The conversation may be voice or txt but is not an online chat associated with the computer game.

Abstract: The present technology provides solutions for crowd-sourcing stream productions for a virtual esports environment. A method can include generating a virtual environment associated with an interactive session that includes a plurality of spectator devices, wherein each of the spectator devices is presented with a different display based on a corresponding vantage point located within the virtual environment; receiving a plurality of media captures from the spectator devices, wherein each of the media captures is captured from the corresponding vantage point of the spectator device within the virtual environment; selecting one of the media captures based on a comparison of visibility of an asset in the virtual environment; and streaming the selected media capture to a primary display on a requesting device.

Abstract: Systems and methods of intent identification for customized dialogue support in virtual environments are provided. Dialogue intent models stored in memory may each specify one or more intents each associated with a dialogue filter. Input data may be received from a user device of a user. Such input data may be captured during an interactive session of an interactive title that provides a virtual environment to the user device. The input data may be analyzed based on the intent models in response to a detected dialogue trigger and may be determined to correspond to one of the stored intents. The dialogue filter associated with the determined intent may be applied to a plurality of available dialogue outputs associated with the detected dialogue filter. A customized dialogue output may be generated in accordance with a filtered subset of the available dialogue outputs.

Abstract: Certain aspects of the present disclosure include systems and techniques for generating content that indicates a sensation associated with audio. One example method generally includes monitoring audio to be played during display of an associated portion of an interactive content stream provided over a communication network to at least one viewing device during an interactive session, and analyzing, via a machine learning component, the audio to determine a sensation associated with at least a portion of the audio. The method may also include determining an effect indicating the sensation, wherein the effect is associated with one or more output devices associated with the at least one viewing device, and outputting an indication of the effect to the associated output devices, wherein the effect is configured to be output along with the audio in real-time with the display of the associated portion of the interactive content stream.

Abstract: The present technology provides solutions for crowd-sourcing stream productions for a virtual esports environment. A method can include generating a virtual environment associated with an interactive session that includes a plurality of spectator devices, wherein each of the spectator devices is presented with a different display based on a corresponding vantage point located within the virtual environment; receiving a plurality of media captures from the spectator devices, wherein each of the media captures is captured from the corresponding vantage point of the spectator device within the virtual environment; selecting one of the media captures based on a comparison of visibility of an asset in the virtual environment; and streaming the selected media capture to a primary display on a requesting device.

Abstract: The present technology provides solutions for spectator-based interactions in a virtual esports environment. A method can include establishing an interactive session associated with the virtual esports environment, the interactive session including a plurality of user devices, wherein a subset of the user devices is associated with designated players, and another subset of the user devices is associated with designated spectators; receiving data from one of the user devices over a communication network, the data indicating a spectator action performed by a spectator associated with the user device; identifying that the spectator action is associated with one of the players in the virtual esports environment; and modifying the virtual esports environment based on the spectator action and the association with the identified player.

Abstract: A method for enabling visualization of audio content of a video game is provided, including the following operations: executing a session of a video game; activating an audio visualization theme for the session of the video game; responsive to activating the audio visualization theme, then dynamically adjusting gameplay video of the session to include visual elements indicative of audio content of the session; wherein said visual elements are rendered in a designated border region of the gameplay video based on the audio content of the session.

Abstract: A disruptive behavior incident flag notification is received from a game player that marks a time during play of a video game corresponding to a potential disruptive behavior incident. A video clip for the disruptive behavior incident flag notification is automatically generated and stored with the disruptive behavior incident flag notification in association with an account of the game player. The game player accesses and reviews the disruptive behavior incident flag notification and corresponding generated video clip. The game player applies a validation indicator to the disruptive behavior incident flag notification. The validation indicator for the disruptive behavior incident flag notification as received from the game player is used to prioritize the disruptive behavior incident flag notification and corresponding generated video clip for platform moderator review.