Abstract: Systems and methods incorporating an embedded sensor in a control stick to detect the presence of an object, such as a thumb. A presence detect signal may be generated by the additional sensor and auto calibration logic then may automatically remove bias from the control stick in real time when the presence detect signal indicates the control stick is not under the influence of a force external to the controller, and therefore at its neutral mechanical position. In further embodiments, embedded sensors are arrayed across an exterior surface of a control stick as a secondary control stick-based positional input device. In such embodiments, tactile or proximity sensor technology may be applied to either improve precision of first positional information generated by the control stick or to control a coordinate space separate from that controlled by first position information provided by the control stick.

Abstract: Systems, methods and apparatus for generating an asset for a simulated environment using digital image capture are disclosed. An outline of an object in a digital image is automatically traced to generate data representing a two-dimensional polygon that encompasses the object. The outline is traced without relying on further input from a user once the digital image of the object has been captured. A portion of the digital image bounded by the two-dimensional polygon is separated from a remaining portion of the digital image. The portion of the image bounded by the two-dimensional polygon is associated with an asset in the simulated environment.

Abstract: Described herein are hand-held controller, system, and method for providing real-time sensations of texture and hardness-softness to a user of the hand-held controller. The hand-held controller comprises a first region to be touched by a user and to provide real-time computer programmable texture sensations to the user in response to a first trigger signal generated by an interactive program; and a second region to be touched by the user and to provide real-time computer programmable hardness-softness sensations to the user in response to a second trigger signal generated by the interactive program.

Abstract: Described herein are hand-held controller, system, and method for providing real-time programmable sensations of texture, hardness-softness, and temperature (thermal) to the hand-held controller. The hand-held controller comprises a first region configured to be touched by a user and to provide a real-time programmable hardness-softness sensation to the user in response to a first trigger signal generated by an interactive program; a second region to be touched by the user and to provide real-time programmable hardness-softness sensations to the user in response to a second trigger signal generated by the interactive program; and a third region to be touched by the user and to provide real-time programmable thermal sensations to the user in response to a third trigger signal generated by the interactive program.

Abstract: Described herein are hand-held controller, system, and method for providing real-time sensations of temperature and texture to a user of the hand-held controller. The hand-held controller comprises a first region to be touched by a user and to provide a real-time computer programmable texture sensation to a user in response to a first trigger signal generated by an interactive program; and a first mechanism, coupled to the first region, to cause the first region to roughen relative to a first state, and to cause the first region to smooth relative to a second state.

Abstract: Described herein are hand-held controller, system, and method for providing real-time sensations of temperature and/or hardness-softness to the hand-held controller. The hand-held controller comprises a first region configured to be touched by a user and to provide a real-time computer programmable hardness-softness sensation to the user in response to a first trigger signal generated by an interactive program; and a first mechanism, coupled to the first region, to cause the first region to harden relative to a first state, and to cause the first region to soften relative to a second state.

Abstract: Methods and systems for processing input by a computing device are presented. One method includes operations for receiving images of a control device that includes an object section, and for determining a location of the control device utilizing image analysis for each captured image. Additionally, the movement of the control device is tracked based on the determined locations, where the tracking of the movement includes receiving inertial sensor information obtained by sensors in the control device, and determining an orientation of the control device based on the sensor information. Additionally, the method includes an operation for translating the movement and orientation of the control device into input for a game executing in the computing device, where the input is translated into a motion and orientation of an object in the game based on the movement of the control device.

Abstract: Methods, computer programs, and systems for interfacing a user with a computer program, utilizing gaze detection and voice recognition, are provided. One method includes an operation for determining if a gaze of a user is directed towards a target associated with the computer program. The computer program is set to operate in a first state when the gaze is determined to be on the target, and set to operate in a second state when the gaze is determined to be away from the target. When operating in the first state, the computer program processes voice commands from the user, and, when operating in the second state, the computer program omits processing of voice commands.

Abstract: Methods, systems and computer programs for determining the location in a field of play of a game controller are provided. A ball section is attached to the game controller to locate the controller using visual information. The method obtains an image of the field of play where the game controller is present, and then finds pixels in the image associated with the ball section. The method further establishes an area encompassing the found pixels and determines a geometric shape based on the area associated with the ball. The location of the controller is calculated based on the geometric shape, with the center of the geometric shape indicating the horizontal and vertical location of the controller, and the size of the geometric shape determining the depth of the controller within the field of play. The location is stored in memory, which is used to drive an action by the computer.

Abstract: Methods, systems, and computer programs for configuring a computer program based on user are provided. One method includes an operation for detecting, by a controller, an object carried by a user, where the object includes a parameter value—e.g., a radio-frequency identification (RFID) tag—that uniquely identifies the object from a plurality of objects. The parameter value is transmitted to a computing device executing the computer program, and the computer program determines if the computer program has user information associated with the transmitted parameter value. The computer program is configured utilizing the user information, when the computer program has the user information for the parameter value.

Abstract: Methods and systems for interfacing a control device with a computer program executing at a base computing device are presented. The method generates a visual cue at a spherical section of the control device and captures an image of the visual cue using an image capture device connected to the base computing device. Further, the method determines whether the visual cue is user feedback or input for the computer program, and processes the visual cue at the base computing device when the visual cue is an input. Additionally, a state of an object being processed is updated by the computer program in response to the input to drive interactivity with the computer program via the control device.

Abstract: Methods and systems for providing thermal feedback are presented. In one embodiment, a controller for interfacing with an interactive program includes an outer surface having a plurality of first surface regions and one or more second surface regions. The second surface regions are arranged in an alternating and adjacent fashion with the first surface regions. A heating source is coupled to the plurality of first surface regions, and a cooling source is coupled to the second surface regions. A thermal controller is provided for determining when to activate the heating source to heat the first surface regions and when to activate the cooling source to cool the second surface regions, based on thermal trigger data generated by the interactive program.

Abstract: A method for providing directional input to a video game is provided. The method initiates with capturing an image of a first object and a second object, the first object and the second object being defined at a fixed distance from each other. A three-dimensional location of the first object is determined based on analysis of the captured image, and a two-dimensional location of the second object is determined based on analysis of the captured image. An input direction for a video game is determined based on the three-dimensional location of the first object and the two-dimensional location of the second object.

Abstract: Input devices for interfacing with a game console to interact with a computer program are disclosed. In one example, the input device includes a controller with a handle and a spherical object that is connected to a first end of the handle. The controller further includes a circuit that identifies the position of the handle. The circuit further includes communication logic to communicate the identified position to the game console during interaction with the computer program. The controller further includes control inputs connected to a second end of the handle, wherein the spherical object is placed in contact with a surface when held by the handle and the circuit updates the identified position of the handle as the handle is pivoted on the surface. The control inputs providing commands that are exchanged with the game console to further interact with the computer program.

Abstract: Methods for pairing devices to a group are disclosed. The methods include initiating a plurality of wireless device for communication with a base computing system. Then, receiving signals indicative of setting of each of the plurality of wireless devices in pairing mode. The method then detects a physical tap between two or more of the plurality of wireless devices. The physical tap setting a pairing of the wireless devices to a group for communication with the base computing system. The devices in the group being managed in a database to associate capabilities of the wireless devices to components of a multimedia feed being used by the group.

Abstract: Methods of pairing a plurality of objects in a multi-interactive object environment are presented. In one example, the method establishes communication between a first and second controller and the base computing device that identifies each controller as being active. A pairing detection algorithm executed on the base computing device is set into pairing mode to receiving signals from the controllers that indicates pairing between the first and second controllers. The base computing device detects a pairing initiation signal from the controllers, where the pair initiation signal is generated in response to detecting physical contact or a signature between the first and second controllers. The base computing device sets first and second controllers as being paired to the player.

Abstract: Methods for enabling group switching of paired wireless devices are disclosed. The method includes receiving signals indicative of setting of each of a plurality of wireless devices in pairing mode. Then, detecting a physical contact between two or more of the plurality of wireless devices. The physical contact setting a pairing of the wireless devices to a group for communication with the base computing system, and enabling the group to participate in interaction with a first multimedia feed. The method further includes detecting switch signal from one of the wireless devices of the group. The switch signal discontinuing the first multimedia feed and enabling interaction with a second multimedia feed, such that each of the wireless devices of the group switch together as a group from the first multimedia feed to the second multimedia feed.

Abstract: To calibrate a tracking system a computing device locates an object in one or more images taken by an optical sensor. The computing device determines environment colors included in the image, the environment colors being colors in the one or more images that are not emitted by the object. The computing device determines one or more trackable colors that, if assumed by the object, will enable the computing device to track the object.