Abstract: An apparatus for capturing image and sound during interactivity with a computer game in a game environment is provided. The apparatus includes a housing and a base stand for supporting the housing. An image capture device is defined along a front portion of the housing. Also, an array of microphones is defined along the front portion of the housing. The array of microphones is defined by a single microphone positioned on a first lateral side of the image capture device and two or more microphones positioned on a second lateral side of the image capture device opposite the first side. The apparatus also includes a connector for connecting to a computing device.

Abstract: A method for adjusting image capture settings for an image capture device is provided. The method initiates with capturing depth information of a scene at the image capture device. Depth regions are identified based on the captured depth information. Then, an image capture setting is adjusted independently for each of the depth regions. An image of the scene is captured with the image capture device, wherein the image capture setting is applied to each of the depth regions when the image of the scene is captured.

Abstract: Targeted sound detection methods and apparatus are disclosed. A microphone array has two or more microphones M0 . . . MM. Each microphone is coupled to a plurality of filters. The filters are configured to filter input signals corresponding to sounds detected by the microphones thereby generating a filtered output. One or more sets of filter parameters for the plurality of filters are pre-calibrated to determine one or more corresponding pre-calibrated listening zones. Each set of filter parameters is selected to detect portions of the input signals corresponding to sounds originating within a given listening zone and filter out sounds originating outside the given listening zone. A particular pre-calibrated listening zone is selected at a runtime by applying to the plurality of filters a set of filter coefficients corresponding to the particular pre-calibrated listening zone.

Abstract: A peripheral device for communicating with a computer gaming system having an image capture device associated therewith is provided. The image capture device is configured to capture image data of the peripheral device and the computer system is configured to exchange wireless communication data with the peripheral device. The peripheral device includes a body having a first location and a second location, where the first location is defined for a first light emitting object and the second location is defined for a second light emitting object. The first and second illuminating objects having a size that is identifiable in captured image data. The first location on the body is at a fixed predetermined distance from the second location. The peripheral device includes one or more buttons, and circuitry interfaced with the first and second light emitting objects.

Abstract: One or more images can be captured with a depth camera having a capture location in a coordinate space. First and second objects in the one or more images can be identified and assigned corresponding first and second object locations in the coordinate space. A relative position can be identified in the coordinate space between the first object location and the second object location when viewed from the capture location by computing an azimuth angle and an altitude angle between the first object location and the object location in relation to the capture location. The relative position includes a dimension of depth with respect to the coordinate space. The dimension of depth is determined from analysis of the one or more images. A state of a computer program is changed based on the relative position.

Abstract: A method and system for determining an intensity value of an interaction with a computer program is described. The method and device includes capturing an image of a capture zone, identifying an input object in the image, identifying an initial value of a parameter of the input object, capturing a second image of the capture zone, and identifying a second value of the parameter of the input object. The parameter identifies one or more of a shape, color, or brightness of the input object and is affected by human manipulation of the input object. The extent of change in the parameter is calculated, which is the difference between the second value and the first value. An activity input is provided to the computer program, the activity input including an intensity value representing the extent of change of the parameter. A method for detecting an intensity value from sound generating input objects, and a computer video game are also described.

Abstract: Methods for determining input to be supplied to a computer program are provided. One of the methods include processing a first video frame having a pattern code before light is applied to the pattern code. The first video frame defines a first characteristic of the pattern code, and the pattern code is defined by at least two tags. The method further includes processing a second video frame having the pattern code when light is applied to the pattern code, such that the second video frame defines a second characteristic of the pattern code. Then, decoding the first characteristic and the second characteristic of the pattern code to produce decoded information. An interactive command is then initiated to the computer program. A type of the interactive command is defined by the decoded information, wherein one of the tags has a reflective surface and one of the tags has a non-reflective surface.

Abstract: A controller provides inputs to control execution of a program by combining controller input information and supplementary information indicating a three-dimensional motion of the controller. The combined input can be obtained by assigning the value of the controller input information as coarse control information and assigning the value of the supplementary input information as fine control information or vice versa.

Abstract: A method for controlling a view of a scene is provided. The method initiates with detecting an initial location of a control object. An initial view of the scene is displayed on a virtual window, the initial view defined by a view-frustum based on a projection of the initial location of the control object through outer edges of the virtual window. Movement of the control object to a new location is detected. An updated view of the scene is displayed on the virtual window, the updated view defined by an updated view-frustum based on a projection of the new location of the control object through the outer edges of the virtual window.

Abstract: Systems, methods and for analyzing game control input data are disclosed. A machine-readable medium having embodied thereon instructions for analyzing game control input data is also disclosed.

Abstract: Systems, methods and for analyzing game control input data are disclosed. A machine-readable medium having embodied thereon instructions for analyzing game control input data is also disclosed.

Abstract: Detecting direction pointing direction when interfacing with a computer program is described. Two or more stereo images presented in front of two or more corresponding image capture devices can be captured. Each image capture device having a capture location in a coordinate space. The image capture devices can be synchronized with a strobe signal that is visible to each image capture device. When a person is captured in the image, first and second body parts of the person in the image can be identified and assigned first and second locations in the coordinate space. A relative position that includes a dimension of depth can be identified in coordinate space between the first location and the second location when viewed from the capture location.

Abstract: A method for processing interactive user control with a scene of a video clip is provided. The method initiates with identifying a head of a user that is to interact with the scene of the video clip. Then, the identified head of the user is tracked during display of the video clip, where the tracking enables detection of a change in position of the head of the user. Next, a view-frustum is adjusted in accordance with the change in position of the head of the user. A computer readable media, a computing device and a system for enabling interactive user control for defining a visible volume being displayed are also included.

Abstract: A method for detecting direction when interfacing with a computer program is provided. The method includes capturing an image presented in front of an image capture device. The image capture device has a capture location in a coordinate space. When a person is captured in the image, the method includes identifying a human head in the image and assigning the human head a head location in the coordinate space. The method also includes identifying an object held by the person in the image and assigning the object an object location in coordinate space. The method further includes identifying a relative position in coordinate space between the head location and the object location when viewed from the capture location. The relative position includes a dimension of depth. The method may be practiced on a computer system, such as one used in the gaming field.

Abstract: A tracking device may include a body, a sound emitter operable to emit a sound, an array of two or more microphones adapted to produce discrete time domain input signals at a runtime, one or more processors coupled to the array of two or more microphones; and a memory coupled to the microphones and the processor. The memory has a set of processor readable instructions embodied therein. The instructions include one or more instructions for: determining a listening direction of the sound source relative to the microphone array from the discrete time domain input signals; using the listening direction in a semi-blind source separation to select filtering functions that separate out sounds from the sound emitter from the discrete time domain input signals; identifying a listening zone containing the sound emitter from the filtering functions; and determining a location of the sound emitter from the identified listening zone.

Abstract: Methods of obtaining input for controlling execution of a game program are disclosed. Controller input information can identify a current position of a user-movable control stick in relation to a rest position of the control stick. Supplementary input information from an environment can indicate a three-dimensional motion of a user-movable object. A combined input for controlling the execution of the game program can be obtained by processing the controller input information and the supplementary input information. The combined input can be obtained by assigning the value of the controller input information representative of a position of the control stick as coarse control information and assigning the value of the supplementary input information representative of the orientation of the user-movable object as fine control information.

Abstract: Systems, methods and for analyzing game control input data are disclosed. A machine-readable medium having embodied thereon instructions for analyzing game control input data is also disclosed.

Abstract: A method and apparatus for capturing image and sound during interactivity with a computer program is provided. The apparatus includes an image capture unit that is configured to capture one or more image frames. Also provided is a sound capture unit. The sound capture unit is configured to identify one or more sound sources. The sound capture unit generates data capable of being analyzed to determine a zone of focus at which to process sound to the substantial exclusion of sounds outside of the zone of focus. In this manner, sound that is captured and processed for the zone of focus is used for interactivity with the computer program.

Abstract: A tracking device for use in obtaining information for controlling an execution of a game program by a processor for enabling an interactive game to be played by a user and related apparatus are disclosed.

Abstract: Targeted sound detection methods and apparatus are disclosed. A microphone array has two or more microphones M0 . . . MM. Each microphone is coupled to a plurality of filters. The filters are configured to filter input signals corresponding to sounds detected by the microphones thereby generating a filtered output. One or more sets of filter parameters for the plurality of filters are pre-calibrated to determine one or more corresponding pre-calibrated listening zones. Each set of filter parameters is selected to detect portions of the input signals corresponding to sounds originating within a given listening zone and filter out sounds originating outside the given listening zone. A particular pre-calibrated listening zone is selected at a runtime by applying to the plurality of filters a set of filter coefficients corresponding to the particular pre-calibrated listening zone.