Abstract: A method, system, computer readable media and cloud systems are provided for rendering virtual reality (VR) views into VR scenes for presentation to a head mounted display (HMD). One method includes sensing a position of a nose of the user when the HMD is worn by the user. The method includes identifying a model of the nose of the user based on the position that is sensed. The model of the nose having a dimension that is based on the position of the nose of the user, when the HMD is worn. The method further includes rendering images to a screen of the HMD to present the VR scenes. The images being augmented to include nose image data from the model of the nose. In one example, the HMD is configured to capture facial feature expressions which are usable to generate avatar faces of the user, and convey facial expressions and/or emotion.

Abstract: Methods, devices, and computer programs for controlling behavior of an electronic device are presented. A method includes an operation for operating the electronic device in a first mode of operation, and an operation for tracking the gaze of a user interfacing with the electronic device. The electronic device is maintained in a first mode of operation as long as the gaze is directed towards a predetermined target. In another operation, when the gaze is not detected to be directed towards the predetermined target, the electronic device is operated in a second mode of operation, which is different from the first mode of operation.

Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.

Abstract: Methods for observing a virtual reality environment of a virtual reality player is are provided. One method includes establishing, by a handheld device of an observer, a connection with a computer executing the virtual reality environment being presented to the virtual reality player using a head mounted display (HMD). Capturing, by a first camera of the handheld device, a current position of the virtual reality player in a real world space. Capturing, by a second camera of the handheld device, a face position of the observer. The face position being monitored to determine a viewing direction to a screen of the handheld device. The screen of the handheld device is configured to present the virtual reality environment and at least part of the virtual reality player interacting in the virtual reality environment.

Abstract: A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. By allowing the spectator to move closer or further away from specific content, the spectators movement toward or away will cause an automatic scaling of content within the virtual-reality content being generated by an HMD player, that is sharing the content with the spectator. Other features include allowing a spectator to adjust the viewing angle of the content. The viewing angle of the content can be moved by allowing the spectator to reach into the content or control the content scene, and then position the content in the viewing angle that is most comfortable to the position of the spectator.

Abstract: Conversation-based context rules for altering virtual reality (VR) gaming and for switching between input languages based on heuristics related to past conversations between users.

Abstract: The disclosure provides methods and systems for warning users of mobile terminals during active phone calls or active data transfer that they approach certain geographical areas known as areas where active phone calls or active data transfer may be interrupted. In one embodiment, a method includes obtaining, by a processor, location information associated with a mobile terminal, determining, by the processor, that the mobile terminal approaches a particular geographical area, the particular geographical area being associated with previous dropped calls based at least in part on historical data, and, based on the determination, sending, by the processor, a warning signal to the mobile terminal for informing a user of the mobile terminal that the mobile terminal is about to enter the particular geographical area.

Abstract: Methods, systems, and computer programs are presented for managing the display of images on a head mounted device (HMD). One method includes an operation for tracking the gaze of a user wearing the HMD, where the HMD is displaying a scene of a virtual world. In addition, the method includes an operation for detecting that the gaze of the user is fixed on a predetermined area for a predetermined amount of time. In response to the detecting, the method fades out a region of the display in the HMD, while maintaining the scene of the virtual world in an area of the display outside the region. Additionally, the method includes an operation for fading in a view of the real world in the region as if the HMD were transparent to the user while the user is looking through the region. The fading in of the view of the real world includes maintaining the scene of the virtual world outside the region.

Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.

Abstract: A method includes the following: presenting gameplay of a video game through a head-mounted display (HMD), the HMD being disposed in a local environment; detecting a person speaking in the local environment, wherein detecting the person speaking includes capturing audio from the local environment by the HMD, and analyzing the captured audio to identify the person speaking in the local environment; responsive to detecting the person speaking in the local environment, presenting a notification through the HMD, the notification providing an option to pause the gameplay of the video game; responsive to receiving a command indicating selection of the option, pausing the gameplay of the video game and presenting through the HMD a view through an externally facing camera of the HMD that enables viewing of the person speaking in the local environment.

Abstract: Systems and methods for reducing an effect of occlusion of a tracker by people are described. When a user is playing a video game using a head-mounted display, a field-of-view for tracking the user is obstructed by a spectator. The video game cannot be displayed at a normal frame rate to the user as a result of the obstruction. The systems and methods described herein determine and identify a source of the obstruction, and implement operations to remove the obstruction.

Abstract: Conversation-based context rules for altering virtual reality (VR) gaming and for switching between input languages based on heuristics related to past conversations between users.

Abstract: A method, system, computer readable media and cloud systems are provided for rendering virtual reality (VR) views into VR scenes for presentation to a head mounted display (HMD). One method includes sensing a position of a nose of the user when the HMD is worn by the user. The method includes identifying a model of the nose of the user based on the position that is sensed. The model of the nose having a dimension that is based on the position of the nose of the user, when the HMD is worn. The method further includes rendering images to a screen of the HMD to present the VR scenes. The images being augmented to include nose image data from the model of the nose. In one example, the HMD is configured to capture facial feature expressions which are usable to generate avatar faces of the user, and convey facial expressions and/or emotion.

Abstract: Conversation-based context rules for altering virtual reality (VR) gaming and for switching between input languages based on heuristics related to past conversations between users.

Abstract: Systems and methods for executing a game presented on a screen of a head mounted display include executing a game. The execution of the game renders interactive scenes of the game on the screen of the HMD. Images identifying a shift in gaze direction of the user wearing the HMD, are received. The gaze shift is detected during viewing of the interactive scenes presented on the HMD screen. Real-world images that are in line with the gaze direction of the user, are captured from a forward-facing camera of the HMD. A portion of the screen is transitioned from a non-transparent mode to a semi-transparent mode in response to the shift in the gaze direction such that at least part of the real world images are presented in the portion of the screen rendering the interactive scenes of the game. The transparent mode is discontinued after a period of time.

Abstract: A method for transitioning gameplay is provided, the method including: receiving a signal to interrupt gameplay of a video game, the gameplay being presented on a head-mounted display; in response to receiving the signal, transitioning the gameplay from an active state to a paused state; wherein transitioning the gameplay includes identifying an intensity of a gameplay aspect, and progressively reducing the intensity of the gameplay aspect before entering the paused state.

Abstract: Methods for simulating a source of sound are provided. One method includes determining, by a computer, a location in physical space of a head of a user. The location is determined by capturing images by a camera of the physical space in which a user is located. The method further includes determining a sound for delivery to two speakers worn by the user and determining, by the computer, an emanating location in the physical space for the sound. The method further includes establishing, by the computer, acoustic signals for each speaker based on the location in the physical space of the head, the sound, the emanating location in the physical space, and a selected auditory characteristics of the user. The auditory characteristics of the user are identified based on a calibration process. The method further includes transmitting, by the computer, the acoustic signals to the two speakers. The acoustic signals simulate that the sound originated at the emanating location in space.

Abstract: A method for executing computer instructions for presenting an interactive environment in a head-mounted display (HMD) is described. The method includes identifying content associated with the interactive environment to be presented on the HMD for a user and determining whether an interactive object within the identified content satisfies a threshold for presentation to the user. The method includes augmenting the interactive object with augmentation data. The augmented data acts to change a characteristic of the interactive object. The operation of augmenting the interactive object is performed after determining that the interactive object does not satisfy the threshold for presentation to the user. The augmentation data modifies the interactive object to conform the interactive object to be within the threshold.

Abstract: A method for gaming. The method includes assigning a default game play profile to a user, wherein the default game play profile includes a default game play style that simulates human game play, and wherein the default game play profile is configured to control game play for the user based on the default game play style. The method includes monitoring a plurality of game plays of the user playing a plurality of gaming applications. The method includes generating a user game play profile of the user by adjusting the default game play style based on the plurality of game plays, wherein the user game play profile includes a user game play style customized to the user. The method includes controlling an instance of a first gaming application based on the user game play style of the user game play profile.

Abstract: A method for assisting game play. The method includes monitoring game play of the user playing a gaming application, wherein the user has a defined task to accomplish, wherein the task is associated with a task type. The method includes determining a task type proficiency rule for the task type based on results of a plurality of players taking on a plurality of tasks having the task type. The method includes determining a player proficiency score for accomplishing the task based on the task type proficiency rule. The method includes determining a user predictive rate of success in accomplishing the task based on the player proficiency score, the task type proficiency rule, and the task. The method includes determining a recommendation for the user based on the user predictive rate of success.