Abstract: Systems and methods for processing operations for head mounted display (HMD) users to join virtual reality (VR) scenes are provided. A computer-implemented method includes providing a first perspective of a VR scene to a first HMD of a first user and receiving an indication that a second user is requesting to join the VR scene provided to the first HMD. The method further includes obtaining real-world position and orientation data of the second HMD relative to the first HMD and then providing, based on said data, a second perspective of the VR scene. The method also provides that the first and second perspectives are each controlled by respective position and orientation changes while viewing the VR scene.

Abstract: Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.

Abstract: A method is provided, including the following method operations: providing a first view of a virtual environment to a first head-mounted display (HMD), the first view being defined from a first location in the virtual environment, and associated to a first virtual character having a first view direction towards a virtual object in the virtual environment; simultaneous with the providing the first view, providing a second view of the virtual environment to a second HMD, the second view being defined from the first location in the virtual environment, and associated to a second virtual character in the virtual environment; wherein providing the second view includes rendering the first virtual character in the second view, the rendering of the first virtual character in the second view being configured to present the first virtual character as having a second location in the virtual environment, the rendering of the first virtual character in the second view being further configured to present the first virtual

Abstract: Methods, systems, devices, and software are described for providing supplemental content for presentation on a mobile device that identifies a video and a portion within the video. In one embodiment, a system includes a mobile device with an integrated video camera that tracks a display playing a movie. The mobile device automatically identifies the current scene in the movie and then accesses supplemental non-video content related to the identified scene. The accessed supplemental non-video content (e.g., audio, tactile, olfactory data) is then presented to the user at the same time the movie is played.

Abstract: Methods, systems, devices, and software are described for providing supplemental content for display on a mobile device. In one embodiment, a system includes a video display that displays video content. A mobile device with an integrated display may track the video display, with a video camera or other methods, and identify the video content in the tracked video display. The mobile device may access supplemental content related to the identified video content, and display the accessed supplemental content on the integrated display.

Abstract: One or more chat servers receives voice signals and pose (location and orientation) signals from devices such as VR headsets associated with respective chat participants. For each participant, the server renders a single stream representing the voices of the other participants, with the voice data in each stream being modified to account for the orientation of the head of the receiving participant. The server sends the streams to the participants for whom the streams are tailored. The voice information representing the chat of the other participants in a stream intended for a particular participant can also be modified to account for the distances between participants and orientations of speakers' heads relative to the particular participant for whom the stream is tailored.

Abstract: A method for executing computer instructions for presenting an interactive environment in a head-mounted display (HMD) is described. The method includes identifying content associated with the interactive environment to be presented on the HMD for a user and determining whether an interactive object within the identified content satisfies a threshold for presentation to the user. The method includes augmenting the interactive object with augmentation data. The augmented data acts to change a characteristic of the interactive object. The operation of augmenting the interactive object is performed after determining that the interactive object does not satisfy the threshold for presentation to the user. The augmentation data modifies the interactive object to conform the interactive object to be within the threshold.

Abstract: A sensor generates signals representing whether a computer game headset is being worn properly so that the wearer may be advised. The sensor may be a pressure sensor or motion sensor or stretch sensor on the headset, or it may be a camera that images the wearer and uses image recognition to determine if the headset is on correctly.

Abstract: A sensor generates signals representing whether a computer game headset is being worn properly so that the wearer may be advised. The sensor may be a pressure sensor or motion sensor or stretch sensor on the headset, or it may be a camera that images the wearer and uses image recognition to determine if the headset is on correctly.

Abstract: A method for determining the location of a portable device relative to a display is provided. An image stream is captured by the portable device when the portable device is positioned proximate to the display. The image stream is captured from a region of the display when the display is actively rendering a content stream, the content stream including embedded content for position determination. The embedded content is detected within the captured image stream, and the location of the portable device relative to the display is determined based on the detected embedded content.

Abstract: A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. By allowing the spectator to move closer or further away from specific content, the spectators movement toward or away will cause an automatic scaling of content within the virtual-reality content being generated by an HMD player, that is sharing the content with the spectator. Other features include allowing a spectator to adjust the viewing angle of the content. The viewing angle of the content can be moved by allowing the spectator to reach into the content or control the content scene, and then position the content in the viewing angle that is most comfortable to the position of the spectator.

Abstract: A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes generating a virtual reality environment to be rendered for a head mounted display (HMD) of an HMD player. The HMD player is provided with an HMD view that is controlled by movement of the HMD by the HMD player. Then, providing a spectator view into the virtual reality environment. The spectator view is associated with a viewing spot directed into the virtual reality environment. The viewing spot is decoupled from the HMD view. In some examples, multiple viewing spots are pre-authored and the spectator is provided with different ones of the viewing spots as the HMD players move around the virtual reality environment.

Abstract: A method, system, computer readable media and cloud systems are provided for generating views of a virtual reality environment for a spectator. One example method includes enabling a spectator to view into a virtual reality environment, and control what specific content within the environment the spectator wishes to see. Motions of an HMD worn by an HMD player can be tracked so as to provide a geared spectator view into the virtual reality environment. The gearing of the spectator view enables a spectator to view the virtual reality content in a more normal way which is not tied to the strict movements of the HMD worn by the HMD player. The gearing effects can be programmable or can be set based on the content being navigated by the HMD player or preferences of the individual spectators.

Abstract: A glove for interfacing with a virtual reality scene presented via a head-mounted display (HMD) is provided. The glove includes a plurality of digits associated with the glove, each digit configured to receive a finger of a user of the glove; and, a plurality of sensors, each configured to identify a degree of flexion and being associated with one of a plurality of predefined locations along the plurality of digits, wherein one of the plurality of sensors at each of the predefined locations is selected as an optimal sensor for the respective predefined location.

Abstract: Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.

Abstract: Methods, apparatus, and computer programs for simulating the source of sound are provided. One method includes operations for determining a location in space of the head of a user utilizing face recognition of images of the user. Further, the method includes an operation for determining a sound for two speakers, and an operation for determining an emanating location in space for the sound, each speaker being associated with one ear of the user. The acoustic signals for each speaker are established based on the location in space of the head, the sound, the emanating location in space, and the auditory characteristics of the user. In addition, the acoustic signals are transmitted to the two speakers. When the acoustic signals are played by the two speakers, the acoustic signals simulate that the sound originated at the emanating location in space.

Abstract: In one implementation, a portable device is provided, including: a sensor configured to generate sensor data for determining and tracking a position and orientation of the portable device during an interactive session of a virtual reality program presented on a main display, the interactive session being defined for interactivity between a user and the virtual reality program; a communications module configured to send the sensor data to a computing device, the communications module being further configured to receive from the computing device an ancillary video stream of the interactive session that is generated based on a state of the virtual reality program and the tracked position and orientation of the portable device.

Abstract: A system is provided, including: a peripheral device having a plurality of electromagnets; a glove interface object, the glove interface object having one or more magnetic sensors configured to sense magnetic fields generated by the electromagnets to determine a location of the glove interface object in an interactive environment, the glove interface object further having one or more inertial sensors configured to detect an orientation of the glove interface object.

Abstract: A method is provided, including: activating a plurality of glove emitters positioned on a glove interface object; using a plurality of proximity sensors positioned at fingertip portions of the glove interface object to determine a proximity of the fingertip portions to the glove emitters; in response to determining a location of the glove interface object within a predefined distance of a peripheral device, activating a plurality of peripheral emitters positioned at the peripheral device, and transitioning, from using the proximity sensors to determine the proximity of the fingertip portions to the glove emitters, to using the proximity sensors to determine a proximity of the fingertip portions to the peripheral emitters.

Abstract: A glove interface object is provided, comprising: a plurality of electromagnets positioned at a wrist area of the glove interface object; a plurality of magnetic sensors respectively positioned at fingertip areas of the glove interface object, wherein each magnetic sensor is configured to generate data indicating distances to each of the electromagnets when each of the electromagnets is activated; a controller configured to control activation of the electromagnets and reading of the magnetic sensors in a time-division multiplexed arrangement, wherein each of the magnetic sensors is read during activation of a single magnetic sensor; a transmitter configured to transmit data derived from the reading of the magnetic sensors to a computing device for processing to generate data representing a pose of a virtual hand, the virtual hand capable of being rendered in a virtual environment presented on a head-mounted display.