Abstract: A glove interface object is provided, comprising: a plurality of fluid channels disposed on a palmar side of the glove interface object, the fluid channels containing a magnetic fluid; a plurality of electromagnets positioned on the palmar side of the glove interface object, each of the plurality of electromagnets being configured when activated to generate a magnetic field that acts on at least a portion of the magnetic fluid; a controller configured to control activation and deactivation of the electromagnets based on received haptic feedback data.

Abstract: A method for processing graphics for a GPU program, translating instructions from a shading language into an intermediate language with a front end of a GPU compiler; translating the instructions from the intermediate language into a GPU object language with a back end of the GPU compiler; wherein the instructions in the shading language include instructions defining a layout of resources for the GPU program.

Abstract: Methods for processing operations of a mobile game to be played via a portable device that is used in various geographic locations of a real world to enable players of the mobile game to complete game-related tasks are provided. One method includes assigning, by a server, a first game-related task to a first geographic location in the real world and establishing, by the server, a wireless connection with the portable device to enable play of the mobile game. The method includes receiving, by the server, global positioning system (GPS) data from the portable device, the GPS data providing a geographic position of the portable device and determining, by the server based on the GPS data, that the portable device is within a proximity of the first geographic location. The method further includes sending, by the server to the portable device via the wireless connection, the first game-related task assigned to the first geographic location.

Abstract: Consumer electronic devices have been developed with enormous information processing capabilities, high quality audio and video outputs, large amounts of memory, and may also include wired and/or wireless networking capabilities. Additionally, relatively unsophisticated and inexpensive sensors, such as microphones, video camera, GPS or other position sensors, when coupled with devices having these enhanced capabilities, can be used to detect subtle features about users and their environments. A variety of audio, video, simulation and user interface paradigms have been developed to utilize the enhanced capabilities of these devices. These paradigms can be used separately or together in any combination. One paradigm automatically creating user identities using speaker identification. Another paradigm includes a control button with 3-axis pressure sensitivity for use with game controllers and other input devices.

Abstract: A method for executing computer instructions for presenting an interactive environment in a head-mounted display (HMD) is described. The method includes identifying content associated with the interactive environment to be presented on the HMD for a user and determining whether an interactive object within the identified content satisfies a threshold for presentation to the user. The method includes augmenting the interactive object with augmentation data. The augmented data acts to change a characteristic of the interactive object. The operation of augmenting the interactive object is performed after determining that the interactive object does not satisfy the threshold for presentation to the user. The augmentation data modifies the interactive object to conform the interactive object to be within the threshold.

Abstract: Devices, systems, and methods are presented for shutting down the 3D effect of active shutter 3D glasses by synchronizing the transparency of the lenses with respect to each other when the 3D glasses have been rotated beyond a threshold angle. The threshold angle can be pre-set through a user-selectable switch. Transitioning from an alternating shutter mode to a synchronized shutter mode can include a fade in which the duty cycles of the lens are adjusted. Direct measurement techniques for measuring the differential roll angle between the lenses and left and right eye images on a display are disclosed.

Abstract: A system and method of tracking a location of a head mounted display and generating additional virtual reality scene data to provide the user with a seamless virtual reality experience as the user interacts with and moves relative to the virtual reality scene. An initial position and pose of the HMD is determined using a camera or similar sensor mounted on or in the HMD. As the HMD is moved into a second position and pose, images of two or more fixed points are captured by the camera or sensor to determine a difference in position and pose of the HMD. The difference in position and pose of the HMD is used to predict corresponding movement in the virtual reality scene and generate corresponding additional virtual reality scene data for rendering on the HMD.

Abstract: A method is provided, including: activating a plurality of glove emitters positioned on a glove interface object; using a plurality of proximity sensors positioned at fingertip portions of the glove interface object to determine a proximity of the fingertip portions to the glove emitters; in response to determining a location of the glove interface object within a predefined distance of a peripheral device, activating a plurality of peripheral emitters positioned at the peripheral device, and transitioning, from using the proximity sensors to determine the proximity of the fingertip portions to the glove emitters, to using the proximity sensors to determine a proximity of the fingertip portions to the peripheral emitters.

Abstract: A glove interface object is provided, comprising: a plurality of electromagnets positioned at a wrist area of the glove interface object; a plurality of magnetic sensors respectively positioned at fingertip areas of the glove interface object, wherein each magnetic sensor is configured to generate data indicating distances to each of the electromagnets when each of the electromagnets is activated; a controller configured to control activation of the electromagnets and reading of the magnetic sensors in a time-division multiplexed arrangement, wherein each of the magnetic sensors is read during activation of a single magnetic sensor; a transmitter configured to transmit data derived from the reading of the magnetic sensors to a computing device for processing to generate data representing a pose of a virtual hand, the virtual hand capable of being rendered in a virtual environment presented on a head-mounted display.

Abstract: Methods systems and computer programs method for playing a game using a portable device are presented. One method includes operations for establishing a connection between a portable device and a computing system executing a game, and for receiving a task at the portable device from the computing system. Further, the portable device is disconnected from the computing system allowing the task to be performed using the portable device independently from the computing system. The method includes interaction of a user with the portable device to receive at the portable device input from the user to perform the task. Once the task is performed, the portable device reports that the task has been performed to the computing system. As a result, the game being executed in the computing system progresses after the portable device reports that the task has been performed.

Abstract: Consumer electronic devices have been developed with enormous information processing capabilities, high quality audio and video outputs, large amounts of memory, and may also include wired and/or wireless networking capabilities. Additionally, relatively unsophisticated and inexpensive sensors, such as microphones, video camera, GPS or other position sensors, when coupled with devices having these enhanced capabilities, can be used to detect subtle features about users and their environments. A variety of audio, video, simulation and user interface paradigms have been developed to utilize the enhanced capabilities of these devices. These paradigms can be used separately or together in any combination. One paradigm automatically creating user identities using speaker identification. Another paradigm includes a control button with 3-axis pressure sensitivity for use with game controllers and other input devices.

Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.

Abstract: Methods and systems for using a position of a mobile device with an integrated display as an input to a video game or other presentation are presented. Embodiments include rendering an avatar on a mobile device such that it appears to overlay a competing user in the real world. Using the mobile device's position, view direction, and the other user's mobile device position, an avatar (or vehicle, etc.) is depicted at an apparently inertially stabilized location of the other user's mobile device or body. Some embodiments may estimate the other user's head and body positions and angles and reflect them in the avatar's gestures.

Abstract: Methods, computer programs, and systems for interfacing a user with a computer program, utilizing gaze detection and voice recognition, are provided. One method includes an operation for determining if a gaze of a user is directed towards a target associated with the computer program. The computer program is set to operate in a first state when the gaze is determined to be on the target, and set to operate in a second state when the gaze is determined to be away from the target. When operating in the first state, the computer program processes voice commands from the user, and, when operating in the second state, the computer program omits processing of voice commands.

Abstract: Methods and systems for displaying a three dimensional image to a rotated viewer are presented. The roll and yaw of a viewer's eyes, with respect to a display, is tracked and used to adjust the orientation of a pair of stereoscopic images so as to maintain a three dimensional image when a viewer is rotated. Adjustment to the orientation of the pair of stereoscopic images may also factor in the orientation of a plurality of viewers, each viewer with a potentially different orientation with respect to the display.

Abstract: Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.

Abstract: A system and method for accessing secured resources using a portable device. When a user with such a portable device is within close proximity to a locked door or other secured resource, a verification process can be automatically initiated on the device. The user verification could utilize all the input and sensor methods on the device. Once the identification process has successfully completed, an access code can be transmitted to the locked door or device via wired or wireless network. This allows for reduced electronics required at these locked doors and allows for more dynamic security measures.

Abstract: Methods and systems for using a position of a mobile device with an integrated display as an input to a video game or other presentation are presented. Embodiments include rendering an avatar on a mobile device such that it appears to overlay a competing user in the real world. Using the mobile device's position, view direction, and the other user's mobile device position, an avatar (or vehicle, etc.) is depicted at an apparently inertially stabilized location of the other user's mobile device or body. Some embodiments may estimate the other user's head and body positions and angles and reflect them in the avatar's gestures.

Abstract: Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.

Abstract: Methods, apparatus, and computer programs for simulating the source of sound are provided. One method includes operations for determining a location in space of the head of a user utilizing face recognition of images of the user. Further, the method includes an operation for determining a sound for two speakers, and an operation for determining an emanating location in space for the sound, each speaker being associated with one ear of the user. The acoustic signals for each speaker are established based on the location in space of the head, the sound, the emanating location in space, and the auditory characteristics of the user. In addition, the acoustic signals are transmitted to the two speakers. When the acoustic signals are played by the two speakers, the acoustic signals simulate that the sound originated at the emanating location in space.