Abstract: A system and method for operating a head mounted display (HMD) is provided. The HMD has a head attachment portion and a viewing module coupled to the head attachment portion. The viewing module includes an inner side having a view port into a screen configuring for rendering a virtual reality scene and an exterior housing. A communications module for exchanging data with a computer system is provided and the computer system is configured to generate the virtual reality scene for the screen. A depth camera is integrated into the viewing module and is oriented to capture depth data of an environment in front of the exterior housing. One method includes processing, by the computer system, the depth data captured by the depth camera to identify hands of a user wearing the HMD in the environment. The hands are rendered into the virtual reality scene. The hands are tracked such that movements of the hands appear as movements of virtual hands extending into the virtual reality scene.

Abstract: Methods, computer programs, and systems for interfacing a user with a computer program, utilizing gaze detection and voice recognition, are provided. One method includes an operation for determining if a gaze of a user is directed towards a target associated with the computer program. The computer program is set to operate in a first state when the gaze is determined to be on the target, and set to operate in a second state when the gaze is determined to be away from the target. When operating in the first state, the computer program processes voice commands from the user, and, when operating in the second state, the computer program omits processing of voice commands.

Abstract: Methods for enabling group switching of paired wireless devices are disclosed. The method includes receiving signals indicative of setting of each of a plurality of wireless devices in pairing mode. Then, detecting a physical contact between two or more of the plurality of wireless devices. The physical contact setting a pairing of the wireless devices to a group for communication with the base computing system, and enabling the group to participate in interaction with a first multimedia feed. The method further includes detecting switch signal from one of the wireless devices of the group. The switch signal discontinuing the first multimedia feed and enabling interaction with a second multimedia feed, such that each of the wireless devices of the group switch together as a group from the first multimedia feed to the second multimedia feed.

Abstract: Methods and systems for processing input by a computing device are presented. One method includes operations for receiving images of a control device that includes an object section, and for determining a location of the control device utilizing image analysis for each captured image. Additionally, the movement of the control device is tracked based on the determined locations, where the tracking of the movement includes receiving inertial sensor information obtained by sensors in the control device, and determining an orientation of the control device based on the sensor information. Additionally, the method includes an operation for translating the movement and orientation of the control device into input for a game executing in the computing device, where the input is translated into a motion and orientation of an object in the game based on the movement of the control device.

Abstract: Methods and systems are provided for head mounted display (HMD) implementations. One example implementation, a HMD includes a circuit for communicating with a computing system that processes multimedia content for display in the HMD. Further included is a front unit of the HMD that has a screen for displaying multimedia content, and the front unit has a set of LEDs. The HMD includes an accelerometer and gyroscope disposed in the front unit of the HMD. A rear section of the HMD is provided having a set of LEDs. A headband connecting the front unit to the rear section is included, such that adjustment of the headband changes a separation distance between at least one of the set of LEDs of the front unit and at least one of the set of LEDs of the rear section. Wherein calibration of the separation distance is performed from time to time to produce and estimated separation distance for tracking of the HMD during use.

Abstract: Systems and method for processing video frames generated for display on a head mounted display (HMD) to a second screen are provided. One example method includes receiving the video frames formatted for display on the HMD, and while passing the video frames to the HMD, selecting a portion of content from the video frames and processing the portion of the content for output to a second screen. The video frames viewed in the HMD are a result of interactive play executed for viewing on the HMD. The second screen configured to render an undistorted view of the interactive play on the HMD. In one example, the method and system enable additional content to be rendered on the second screen (e.g., second screen content, such as social interactive play with others, other non-game content, player-player communication, etc.).

Abstract: Methods and systems for processing input by a computing device are presented. One method includes operations for receiving images of a control device that includes an object section, and for determining a location of the control device utilizing image analysis for each captured image. Additionally, the movement of the control device is tracked based on the determined locations, where the tracking of the movement includes receiving inertial sensor information obtained by sensors in the control device, and determining an orientation of the control device based on the sensor information. Additionally, the method includes an operation for translating the movement and orientation of the control device into input for a game executing in the computing device, where the input is translated into a motion and orientation of an object in the game based on the movement of the control device.

Abstract: A number of brightness samples are taken outside a shape to compensate for blooming of the shape in an image generated by a digital camera. The brightness of each of the samples is determined and averaged, and the size of the shape is adjusted based on the difference between the brightness of the shape and the average of the brightness samples.

Abstract: A method for executing a game presented on a screen of a head mounted display (HMD) is provided. Execution renders interactive scenes of the game on the screen. The method includes receiving data of the HMD worn by a user to identify an HMD spatial position. The method also includes receiving data of a controller held by the user to identify a controller spatial position. During game play, the method includes rendering a point of view into the interactive scenes of the game on the screen, where the point of view is a volume of space rendered in three-dimensions. The method includes adjusting the point of view as the HMD spatial position is detected to change. The controller can drive interactivity in the game and changes in position of the controller and the HMD are correlated to provide an immersive three-dimensional game play experience.

Abstract: A head mounted display is provided. The head mounted display includes a head attachment portion and a viewing module coupled to the head attachment portion. The viewing module includes an inner portion having a view port into a screen configuring for rendering image content, and an exterior housing. Further included are a plurality illuminating elements integrated with the exterior housing of the viewing module. The plurality of illumination elements defined for image tracking of the head mounted display. Illumination logic is provided for controlling the plurality of illumination elements to be active or inactive during use of the head mounted display.

Abstract: A method for providing directional input to a video game is provided. The method initiates with capturing an image of a first object and a second object, the first object and the second object being defined at a fixed distance from each other. A three-dimensional location of the first object is determined based on analysis of the captured image, and a two-dimensional location of the second object is determined based on analysis of the captured image. An input direction for a video game is determined based on the three-dimensional location of the first object and the two-dimensional location of the second object.

Abstract: Detection and prevention of false positives associated with a handheld controller are provided. Information is stored in memory regarding indicia of false positive input associated with a handheld controller used to control media usage. Sensor information is monitored at the handheld controller. It may be detected that the monitored sensor information matches one or more indicia of false positive input. Subsequent input received from the handheld controller may then be nullified, such that the nullified input is not registered and does not result in control changes to the associated media. It may then be detected that the monitored sensor information no longer matches one or more indicia of false positive input. Subsequently, nullification is ended, and subsequent input received from the handheld game controller is registered normally and results in control changes to the associated media.

Abstract: Systems and methods incorporating an embedded sensor in a control stick to detect the presence of an object, such as a thumb. A presence detect signal may be generated by the additional sensor and auto calibration logic then may automatically remove bias from the control stick in real time when the presence detect signal indicates the control stick is not under the influence of a force external to the controller, and therefore at its neutral mechanical position. In further embodiments, embedded sensors are arrayed across an exterior surface of a control stick as a secondary control stick-based positional input device. In such embodiments, tactile or proximity sensor technology may be applied to either improve precision of first positional information generated by the control stick or to control a coordinate space separate from that controlled by first position information provided by the control stick.

Abstract: Methods of pairing a controllers for game play is presented. In one example, a method of pairing controllers to a base computing device for playing a game executed on the base computing device is provided. The method includes receiving a pairing request from one of a first or a second controller. The pair request is generated in response physical contact between the first and second controllers. The method assigns the first and second controllers as a first pairing for a first player and assigns the first pairing to a first color. The method includes transmitting the first color to the first or second controllers, such that at least one of the first and second controllers for the first pairing is configured to illuminate in the first color. Additional pairs of controllers will be assigned a different color, so that each player has a color differentiated color on their respective controller.

Abstract: Methods of pairing a plurality of objects in a multi-interactive object environment are presented. In one example, the method establishes communication between a first and second controller and the base computing device that identifies each controller as being active. A pairing detection algorithm executed on the base computing device is set into pairing mode to receiving signals from the controllers that indicates pairing between the first and second controllers. The base computing device detects a pairing initiation signal from the controllers, where the pair initiation signal is generated in response to detecting physical contact or a signature between the first and second controllers. The base computing device sets first and second controllers as being paired to the player.

Abstract: An image capture device includes: a housing; a first camera defined along a front surface of the housing; a first camera controller configured to control the first camera to capture images of an interactive environment during user interactivity at a first exposure setting; a second camera defined along the front surface of the housing; a second camera controller configured to control the second camera to capture images of the interactive environment during the user interactivity at a second exposure setting lower than the first exposure setting, the captured images from the second camera being analyzed to identify and track an illuminated object in the interactive environment.

Abstract: A controller device to interface with a computer gaming system includes a body having a handle and an object disposed at one end of the handle. A touch surface is disposed on one side of the handle. The touch surface has an indicator that is identified by a surface characteristic on the touch surface. The touch surface provides an area for receiving directionality control in response to interfacing by a finger of a user. In addition to the touch surface, a plurality of buttons are disposed on the body. A circuitry is disposed in the body of the controller. The circuitry is configured to receive data indicative of a directionality control and transmit the data to a game console for impacting an action by a program executing on the computer gaming system.

Abstract: A method for managing multi-player interactivity with an interactive application is provided, including the following method operations: determining a location of a first controller; determining a location of a second controller; determining a location of a biometric identifier of a first user; determining a location of a biometric identifier of a second user; pairing the first controller to the first user based on the location of the first controller and the location of the biometric identifier of the first user; pairing the second controller to the second user based on the location of the second controller and the location of the biometric identifier of the second user.

Abstract: Methods and systems for providing thermal feedback are presented. In one embodiment, a controller for interfacing with an interactive program includes an outer surface having a plurality of first surface regions and one or more second surface regions. The second surface regions are arranged in an alternating and adjacent fashion with the first surface regions. A heating source is coupled to the plurality of first surface regions, and a cooling source is coupled to the second surface regions. A thermal controller is provided for determining when to activate the heating source to heat the first surface regions and when to activate the cooling source to cool the second surface regions, based on thermal trigger data generated by the interactive program.

Abstract: Methods for pairing devices to a group are disclosed. The methods include initiating a plurality of wireless device for communication with a base computing system. Then, receiving signals indicative of setting of each of the plurality of wireless devices in pairing mode. The method then detects a physical tap between two or more of the plurality of wireless devices. The physical tap setting a pairing of the wireless devices to a group for communication with the base computing system. The devices in the group being managed in a database to associate capabilities of the wireless devices to components of a multimedia feed being used by the group.