Abstract: Methods, systems, and devices are described for providing overlay content to be placed over captured video content for display on a mobile device. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera and display may capture video data which includes the video content from the video display. The location of the video content within the captured video data may be tracked. The mobile device may access overlay content, and display the accessed overlay content over the tracked video content.

Abstract: A thermal imaging interface for control of a computer program may obtain one or more thermal infrared images of one or more objects with one or more thermographic cameras. The images may be analyzed to identify one or more characteristics of the objects. Such characteristics may be used as a control input in the computer program.

Abstract: A system and method is provided for controlling a device through air pressure waves, or “sound”. The system and method involve receiving a sound and analyzing the sound to determine whether or not it has one or more predetermined characteristics. If it is determined that the sound does have one or more predetermined characteristics, at least one control signal is generated for the purpose of controlling at least one aspect of the device.

Abstract: Mechanisms are provided for performing a floating point collect and operate for a summation across a vector for a dot product operation. A routing network placed before the single instruction multiple data (SIMD) unit allows the SIMD unit to perform a summation across a vector with a singe stage of adders. The routing network routes the vector elements to the adders in a first cycle. The SIMD unit stores the results of the adders into a results vector register. The routing network routes the summation results from the results vector register to the adders in a second cycle. The SIMD unit then stores the results from the second cycle in the results vector register.

Abstract: Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video.

Abstract: Embodiments of the present disclosure relate to a method, system, and computer-readable medium for locating a sensor of a gaming console relative to a position of a display device in a gaming system includes displaying an image on the display device, estimating the first position and first orientation of the display device relative to the portable device, once the sensor on the portable device has found the image on the display device, instructing the user to move the portable device to a new position, estimating the second position and second orientation of the display device relative to the portable device, once the sensor on the portable device has found the image on the display device, determining the size of the display device using information gathered during the estimating of the first position and orientation and the estimating of the second position and orientation, and determining the orientation of the display device relative to a sensor of a gaming console using the two findings sent to the gaming

Abstract: Methods, systems, and devices are disclosed for preparing to prefetch memory in 3D graphical shader programs. Based on the memory addresses of texels from a texture map that were previously read, a memory address of a to-be-read texel is estimated by using a first-order derivative of the memory address with respect to pixel distance. The estimated memory address is then prefetched for use when the pixel corresponding to the texel is rendered. Whether or not to perform the estimation of the texel memory address can be determined by whether the corresponding pixels are on the same, flat facet on a 3D model. Multiple directions on the facet can be used for memory address estimation as well as higher-order derivatives.

Abstract: Methods, systems, devices, and software are described for providing supplemental content for presentation on a mobile device that identifies a video and a portion within the video. In one embodiment, a system includes a mobile device with an integrated video camera that tracks a display playing a movie. The mobile device automatically identifies the current scene in the movie and then accesses supplemental non-video content related to the identified scene. The accessed supplemental non-video content (e.g., audio, tactile, olfactory data) is then presented to the user at the same time the movie is played.

Abstract: A method for determining the location of a portable device relative to a display is provided. An image stream is captured by the portable device when the portable device is positioned proximate to the display. The image stream is captured from a region of the display when the display is actively rendering a content stream, the content stream including embedded content for position determination. The embedded content is detected within the captured image stream, and the location of the portable device relative to the display is determined based on the detected embedded content.

Abstract: Devices, systems, and methods are presented for shutting down the 3D effect of active shutter 3D glasses by synchronizing the transparency of the lenses with respect to each other when the 3D glasses have been rotated beyond a threshold angle. The threshold angle can be pre-set through a user-selectable switch. Transitioning from an alternating shutter mode to a synchronized shutter mode can include a fade in which the duty cycles of the lens are adjusted. Direct measurement techniques for measuring the differential roll angle between the lenses and left and right eye images on a display are disclosed.

Abstract: Methods, apparatus, and computer programs for simulating the source of sound are provided. One method includes operations for determining a location in space of the head of a user utilizing face recognition of images of the user. Further, the method includes an operation for determining a sound for two speakers, and an operation for determining an emanating location in space for the sound, each speaker being associated with one ear of the user. The acoustic signals for each speaker are established based on the location in space of the head, the sound, the emanating location in space, and the auditory characteristics of the user. In addition, the acoustic signals are transmitted to the two speakers. When the acoustic signals are played by the two speakers, the acoustic signals simulate that the sound originated at the emanating location in space.

Abstract: A tracking system for improving observability of a marker in an image. The tracking system includes a memory unit that stores data; an imaging unit that images the marker and the image; a processor unit that detects the marker in the image; and a communication unit that transmits and receives data. The processor unit determines a first confidence level indicating a visibility of the marker to a user.

Abstract: Methods, devices, and computer programs for controlling behavior of an electronic device are presented. A method includes an operation for operating the electronic device in a first mode of operation, and an operation for tracking the gaze of a user interfacing with the electronic device. The electronic device is maintained in a first mode of operation as long as the gaze is directed towards a predetermined target. In another operation, when the gaze is not detected to be directed towards the predetermined target, the electronic device is operated in a second mode of operation, which is different from the first mode of operation.

Abstract: Methods, computer programs, and systems for interfacing a user with a computer program, utilizing gaze detection and voice recognition, are provided. One method includes an operation for determining if a gaze of a user is directed towards a target associated with the computer program. The computer program is set to operate in a first state when the gaze is determined to be on the target, and set to operate in a second state when the gaze is determined to be away from the target. When operating in the first state, the computer program processes voice commands from the user, and, when operating in the second state, the computer program omits processing of voice commands.

Abstract: Methods and systems for playing video games with a controller having a display that shares content with a main display are provided. According to embodiments of the invention, a method is provided for interactive gameplay of a video game. The method initiates with executing a video game, the video game providing a virtual environment. A primary view of the virtual environment is rendered on a primary display. A location and orientation of a handheld device in a vicinity of the primary display are tracked. A secondary view of the virtual environment is rendered on the handheld device based on the tracked location and orientation of the handheld device.

Abstract: A system creates three-dimensional computer models of physical objects by displaying illumination patterns on a display device to incidentally illuminate a physical object. A video camera acquires images of the object illuminated by the patterns. The patterns can include motion and multiple colors for acquiring images with large variations in surface shading of the object. Shading values from acquired images of the object are analyzed to determine the orientations of points on the object's surface. The system evaluates the quality of acquired images and selects patterns tailored to specific attributes of objects. The points' orientations are determined by comparing the points' shading values with an illumination model or shading values acquired from a calibration shading object. A model surface is fitted to the points' orientations. Applications may utilize the model for any purpose, including creating and exchanging customized virtual objects, enhanced object tracking, and videoconferencing applications.

Abstract: In one embodiment described herein, an automated rating system for an electronic game includes a collector configured to collect game data pertaining to the electronic game and to collect implicit user data pertaining to one or more users, a rating processor configured to rate the game based on the collected game data and implicit user data, and a recommender configured to provide a recommendation as a function of the operation of the game rating.

Abstract: Methods and systems for a centralized database for 3-D and other information in videos are presented. A centralized database contains video metadata such as camera, lighting, sound, object, depth, and annotation data that may be queried for and used in the editing of videos, including the addition and removal of objects and sounds. The metadata stored in the centralized database may be open to the public and admit contributor metadata.

Abstract: Methods and systems for enabling a user to interface with an interactive application using a handheld device are provided. According to embodiments of the invention, a primary video stream of an interactive application is rendered on a display. Simultaneously, a data feed of the interactive application is transmitted to a handheld device. The data feed is processed on the handheld device to produce an ancillary video stream which is rendered on the handheld device. Interactive input is received at the handheld device while rendering the ancillary video stream. The interactive input is applied to set a virtual tag which defines an event to be rendered on the display when the state of the interactive application reaches a predetermined configuration so as to trigger execution of the virtual tag by the interactive application.

Abstract: Methods and systems for enabling a handheld device to capture video of an interactive session of an interactive application presented on a main display are provided. An interactive session of the interactive application defines interactivity between a user and the interactive application. An initial position and orientation of a handheld device operated by a spectator are determined. A current state of the interactive application based on the interactivity between the user and the interactive application is determined The position and orientation of the handheld device are tracked during the interactive session. A spectator video stream of the interactive session based on the current state of the interactive application and the tracked position and orientation of the handheld device is generated. The spectator video stream is rendered on a handheld display of the handheld device.