Abstract: To enhance the sensory experience of voice, in some cases at a later time than the speech was spoken to enable reliving emotions and experiences, vocal sounds captured by a microphone are processed by a computer game controller API. The API plays back the vocal sounds at a later time in haptic format on the controller. The vocal sounds may be computer game dialogue, party chat, or vocal sounds of the user as demanded by the computer game.

Abstract: The 3D audio perception of a listener such as a computer gamer is tested “stereoscopically” and the results input to a source of audio such as a computer game. Audio from the source of audio (such as a head-mounted display of a computer game system or speaker outputting audio from a game console) may be altered to account for the listener's measured 3D audio acuity. In addition, or alternatively, visual or haptic cues may be provided to alert the listener of 3D audio events.

Abstract: Methods and systems are provided for integrating media cues into virtual reality scenes presented on a head mounted display (HMD) is disclosed. The method includes presenting a virtual reality scene on a display of an HMD. The method further includes receiving sensor data from one or more sensors in a real-world space in which the HMD is located. Then, identifying an object location of an object in the real-world space that produces a sound. The method includes generating a media cue in the virtual reality scene presented in the HMD. The media cue is presented in a virtual location that is correlated to the object location of the object in the real-world space.

Abstract: A method including executing game logic of a video game to generate a plurality of video frames for a game play of the video game by a player, wherein game state data is generated during the executing the game logic. The method including determining a current context in the game play of the video game based on the game state data. The method including determining a user sentiment of the player towards the current context in the game play of the video game. The method including determining that the user sentiment of the player is inconsistent with an expected user sentiment for the current context. The method including generating an in-game effect for the current context. The method including presenting the in-game effect simultaneous with one or more video frames associated with the current context in the game play of the video game.

Abstract: Systems and methods for customized dialogue support in virtual environments are provided. Dialogue maps stored in memory may specify dialogue triggers each associated with a corresponding dialogue instruction. Data regarding an interactive session associated with a user device may be monitored based on one or more of the stored dialogue maps. The presence of one of the dialogue triggers specified by the one or more dialogue maps may be detected based on the monitored data. Customized dialogue output may be generated in response to the detected dialogue trigger and based on the dialogue instruction corresponding to the detected dialogue trigger. The customized dialogue output may be provided to the interactive session in real-time with detection of the detected dialogue trigger.

Abstract: A method for generating game duration metrics includes assembling a gaming session for a game, with the gaming session identifying a first player and a second player, and accessing a database that includes an historical duration metric for playing the game by each of the first player and the second player. The method also includes accessing contextual data related to the gaming session to be played by the first player and the second player, and generating a prediction of time metrics for the first player and the second player. The predicted time metrics provide an estimated duration time for play of the gaming session. The method further includes executing the gaming session for the first player and the second player. As the gaming session is progressed by the first player and the second player, the duration time for the gaming session is updated periodically.

Abstract: An audio signal processing apparatus in which different pieces of predetermined parameter information regarding acoustic transfer in a head of a listener are retained as preset candidates, a parameter information list including the retained preset candidates is presented, to prompt a user to select parameter information, and an audio signal for the user is generated by using the user-selected parameter information.

Abstract: A method for providing assistance during gameplay is described. The method includes accessing a profile model associated with a user account of a user. The profile model is used to generate one or more predictive indicators based on a plurality of game contexts of one or more games. The method further includes receiving a request for accessing a game for a game session via the user account and generating assistance input for the user responsive to the one or more predictive indicators that the user will be unable to complete a task in the game. The task is associated to a game context. The assistance input is provided before the user performs the task.

Abstract: Methods and systems for processing audio for a user include identifying an interactive zone of the user as the user is interacting with a video game in a real-world environment. The real-world environment is monitored to detect any changes that can affect the interactive zone. Responsive to detecting changes, a volume of the audio directed to one side or both side of a headphone providing the audio to one or both ears of the user is dynamically adjusted. The adjustment to the audio is to prevent the user from getting distracted while interacting with the video game.

Abstract: Methods and systems are provided. One method is for controlling a plurality of haptic sensors of a physical headset of a user interacting in a virtual reality space. The method includes identifying position and orientation of a character of the user in a scene of the virtual reality space and a three-dimensional (3D) location of an audio object in the scene. The character of the user being associated with the user. The method includes associating a virtual headset to a head of the character. The virtual headset moves as the position and orientation of the character moves in the scene, and the virtual headset includes a plurality of virtual haptic sensors. The method includes applying a magnitude to each of the plurality of haptic sensors of the physical headset based on a directional distance of each of the plurality of virtual haptic sensors of the virtual headset to the audio object in the scene.

Abstract: The present disclosure generally relates to providing virtual education and education to a user. More specifically, the present system relates to educating and onboarding spectators of electronic sports (eSports) events. The onboarding activities are used to further engage the spectators with the eSports event in general, as well as the game played during the eSports event. In other aspects, the eSports onboarding activity may be modified based on the type of game being played, the user's experience with the specific game or game genre, and other user preferences.

Abstract: Systems and methods for dynamic audio optimization associated with digital content are provided. One or more audio profiles including one or more audio settings for one or more audio output devices available to a user may be stored in memory. An incoming audio stream associated with a current interactive session of the user and real-world audio within an identified real-world space where the user is located may be monitored. One or more audio deviations may be detected based on a comparison of the incoming audio stream and the real-world audio within the identified real-world space. An audio profile associated with the current interactive session may be automatically recalibrated to modify at least one of the audio settings. The audio output device may then process audio of the incoming audio stream in accordance with the at least one modified audio setting.

Abstract: Methods of the present disclosure may collect data when a user plays one or more different types of games when determinations are made as to whether the difficulty of a game should be changed. The collected data maybe evaluated to identify whether a user gaming performance level corresponds to an expected level of performance. When the user gaming performance level does not correspond to an expected level of performance, parameters that change the difficultly of the game may be changed automatically. Parameters that relate to movement speed, delay or hesitation, character strengths, numbers of competitors, or other metrics may be changed incrementally until a current user performance level corresponds to an expectation level of a particular user currently playing the game. At this time, the user expectation level may be changed, and the process may be repeated as skills of the user are developed over time.

Abstract: Methods and systems are provided for integrating media cues into virtual reality scenes presented on a head mounted display (HMD) is disclosed. The method includes presenting a virtual reality scene on a display of an HMD. The method further includes receiving sensor data from one or more sensors in a real-world space in which the HMD is located. Then, identifying an object location of an object in the real-world space that produces a sound. The method includes generating a media cue in the virtual reality scene presented in the HMD. The media cue is presented in a virtual location that is correlated to the object location of the object in the real-world space.

Abstract: Methods and systems are provided for providing navigation assistance using eye gaze of a user. An example method provides assistive navigation in a video game. The method includes receiving input from a user device during a gameplay session of the video game. The method further includes capturing eye gaze of the user during the gameplay to identify a region of a scene of the video game associated with said eye gaze. Then, activating gaze navigation to move a focus of the scene to the region identified using the captured eye gaze. The gaze navigation is triggered automatically without said input from the user device.

Abstract: Methods of the present disclosure may also identify when certain users perform well at certain activities and perform poorly when performing other activities. A particular user could perform very well at a swimming game yet perform poorly at the first-person shooter game. This performance difference may be based on a physical impairment, be based on a lack of training, or be based on other factors. When a potential performance deficiency is identified, a user may be provided with a set of selections that allow the user to participate in a training session or that may allow the user to change functions of a gaming controller to account for the apparent performance deficiency. This additional training or change in controller functions may allow a user to have a more enjoyable user experience or may allow the user to perform at a higher level.

Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.

Abstract: Methods and systems are provided for augmenting voice output of a virtual character in an augmented reality (AR) scene. The method includes examining, by a server, the AR scene, said AR scene includes a real-world space and the virtual character overlaid into the real-world space at a location, the real-world space includes a plurality of real-world objects present in the real-world space. The method includes processing, by the server, to identify an acoustics profile associated with the real-world space, said acoustics profile including reflective sound and absorbed sound associated with real-world objects proximate to the location of the virtual character. The method includes processing, by the server, the voice output by the virtual character while interacting in the AR scene; the processing is configured to augment the voice output based on the acoustics profile of the real-world space, the augmented voice output being audible by an AR user viewing the virtual character in the real-world space.

Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.

Abstract: Methods and systems for interacting with an augmented reality application includes a providing an array of barometric pressure sensors within a housing of a wearable device to capture pressure variances detected from motion of one or more facial features that are proximate to the array of barometric pressure sensors. The pressure variances are analyzed to identify motion metrics related to the motion of the facial features. The motion metrics are used to derive engagement metrics of the user to content of the augmented reality application presented to the user.