Abstract: A method comprises receiving one or more depth images from a depth camera, the depth images indicating a depth of a surface imaged by each pixel of the depth images. The method may further comprise identifying a human subject imaged by the depth images and recognizing within one or more of the depth images a beacon emitted from a control device. A position of the control device may be assessed in three dimensions, and the control device may be associated with the human subject based on a proximity of the control device to the human subject or other parameter of the control device with relation to the human subject.

Abstract: A method comprises detecting a control device, and if the control device is not bound to the computing system, detecting an optical beacon emitted from the control device and binding the control device to the computing system.

Abstract: A method comprises receiving one or more depth images from a depth camera, the depth images indicating a depth of a surface imaged by each pixel of the depth images. The method may further comprise identifying a human subject imaged by the depth images and recognizing within one or more of the depth images a beacon emitted from a control device. A position of the control device may be assessed in three dimensions, and the control device may be associated with the human subject based on a proximity of the control device to the human subject or other parameter of the control device with relation to the human subject.

Abstract: Embodiments are disclosed that relate to pushable buttons comprising individually controllable display devices. For example, one disclosed embodiment provides a hand-held game controller comprising a body and a plurality of pushable buttons movably coupled to the body, each pushable button comprising a transparent cap and an individually controllable display device arranged behind the transparent cap such that the display device is viewable through the transparent cap. The hand-held game controller further comprises a controller configured to receive an input from an application requesting display of a first icon on a first display device of a first pushable button of the plurality of pushable buttons and a second icon on a second display device of a second button of the plurality of pushable buttons, and, in response, display the first icon on the first display device and display the second icon on the second display device.

Abstract: Embodiments are disclosed that relate to dynamically scaling a mapping between a touch sensor and a display screen. One disclosed embodiment provides a method including setting a first user interface mapping that maps an area of the touch sensor to a first area of the display screen, receiving a user input from the user input device that changes a user interaction context of the user interface, and in response to the user input, setting a second user interface mapping that maps the area of the touch sensor to a second area of the display screen. The method further comprises providing to the display device an output of a user interface image representing the user input at a location based on the second user interface mapping.