Abstract: A method is provided, including: providing a first view of a virtual environment to a first HMD, the first view having a first view direction towards a virtual object, the first view being from a first-person perspective positioned at the first location; simultaneously, providing a second view to a second HMD, the second view being from a first-person perspective positioned at the first location, and rendering in the second view a virtual character associated to the first view, the rendering configured to present the virtual character as being positioned at a second location, and configured to present the virtual character having a second view direction adjusted relative to the first view direction so as to be from a first-person perspective of the virtual character as the virtual character is positioned at the second location, and so as to be towards the virtual object as shown in the second view.

Abstract: A system for performing a pinch and hold gesture is described. The system includes a head-mounted display (HMD) and a glove, which is worn by a hand of the user. Each finger segment of the glove includes a sensor for detecting positions of the finger segment when moved by the hand. The system includes a computing device interfaced with the HMD and the glove. The computing device analyzes data from the sensors of the finger segments to determine that a pinch and hold gesture is performed by at least two of the finger segments. Moreover, the computing device generates image data that is communicated to the HMD, such that a scene rendered on the HMD is modified to render a visual cue indicative of a location in the scene at which the pinch and hold gesture is associated.

Abstract: A method for real-time motion capture for a person when interfacing with an application executed by a computer is provided. The method includes capturing a space using a camera interfaced with the computer. The space includes at least part of the person. Identifying a plurality of markers disposed on the person. The plurality of markers is associated with at least a torso, arms and legs of the person. Capturing movement of the person by tracking the plurality of markers from images taken by the camera. The method is configured to interpret one or more movements of the person as an input for the application, while the movement of the person is tracked using the plurality of markers.

Abstract: A method is provided, including: providing a first view of a virtual environment to a first HMD, the first view having a first view direction towards a virtual object, the first view being from a first-person perspective positioned at the first location; simultaneously, providing a second view to a second HMD, the second view being from a first-person perspective positioned at the first location, and rendering in the second view a virtual character associated to the first view, the rendering configured to present the virtual character as being positioned at a second location, and configured to present the virtual character having a second view direction adjusted relative to the first view direction so as to be from a first-person perspective of the virtual character as the virtual character is positioned at the second location, and so as to be towards the virtual object as shown in the second view.

Abstract: A system for performing a pinch and hold gesture is described. The system includes a head-mounted display (HMD) and a glove, which is worn by a hand of the user. Each finger segment of the glove includes a sensor for detecting positions of the finger segment when moved by the hand. The system includes a computing device interfaced with the HMD and the glove. The computing device analyzes data from the sensors of the finger segments to determine that a pinch and hold gesture is performed by at least two of the finger segments. Moreover, the computing device generates image data that is communicated to the HMD, such that a scene rendered on the HMD is modified to render a visual cue indicative of a location in the scene at which the pinch and hold gesture is associated.

Abstract: A method is provided, including the following method operations: providing a first view of a virtual environment to a first head-mounted display (HMD), the first view being defined from a first location in the virtual environment, and associated to a first virtual character having a first view direction towards a virtual object in the virtual environment; simultaneous with the providing the first view, providing a second view of the virtual environment to a second HMD, the second view being defined from the first location in the virtual environment, and associated to a second virtual character in the virtual environment; wherein providing the second view includes rendering the first virtual character in the second view, the rendering of the first virtual character in the second view being configured to present the first virtual character as having a second location in the virtual environment, the rendering of the first virtual character in the second view being further configured to present the first virtual

Abstract: A method for interfacing with a scene is provided, including: rendering display data on a main display, the display data defining a scene rendered on the main display, the display data being configured to include a visual cue; capturing the display data by an image capture device incorporated into a portable device; analyzing the captured display data to identify the visual cue; in response to identification of the visual cue, determining additional information that is in addition to the scene that is displayed on the main display, the additional information defining graphics or text to be added to the scene; presenting the additional information on a personal display incorporated into the portable device, the presentation of the additional information being synchronized to the rendering of the display data on the main display.

Abstract: A system for performing a pinch and hold gesture is described. The system includes a head-mounted display (HMD) and a glove, which is worn by a hand of the user. Each finger segment of the glove includes a sensor for detecting positions of the finger segment when moved by the hand. The system includes a computing device interfaced with the HMD and the glove. The computing device analyzes data from the sensors of the finger segments to determine that a pinch and hold gesture is performed by at least two of the finger segments. Moreover, the computing device generates image data that is communicated to the HMD, such that a scene rendered on the HMD is modified to render a visual cue indicative of a location in the scene at which the pinch and hold gesture is associated.

Abstract: A method for interfacing with a video game is provided, including: rendering display data on a main display, the display data defining a scene rendered by the video game, the display data being configured to include a visual cue; capturing the display data by an image capture device incorporated into a portable device; analyzing the captured display data to identify the visual cue; in response to identification of the visual cue, determining additional information that is in addition to the scene of the video game that is displayed on the main display, the additional information defining graphics or text to be added to the scene of the video game; presenting the additional information on a personal display incorporated into the portable device, the presentation of the additional information being synchronized to the rendering of the display data on the main display.

Abstract: A tracking device for use in obtaining information for controlling an execution of a game program by a processor for enabling an interactive game to be played by a user and related apparatus are disclosed.

Abstract: A method for real-time motion capture for a person when interfacing with an application executed by a computer is provided. The method includes capturing a space using a camera interfaced with the computer. The space includes at least part of the person. Identifying a plurality of markers disposed on the person. The plurality of markers is associated with at least a torso, arms and legs of the person. Capturing movement of the person by tracking the plurality of markers from images taken by the camera. The method is configured to interpret one or more movements of the person as an input for the application, while the movement of the person is tracked using the plurality of markers.

Abstract: Methods for real time motion capture for controlling an object in a video game are provided. One method includes defining a model of a control object and identifying a marker on the control object. The method also includes capturing movement associated with the control object with a video capture device. Then, interpreting the movement associated with the control object to change a position of the model based on data captured through the video capture device, wherein the data captured includes the marker. The method includes moving the video game object presented on the display screen in substantial real-time according to the change of position of the model.

Abstract: A method is provided, including the following method operations: providing a first view of a virtual environment to a first head-mounted display (HMD), the first view being defined from a first location in the virtual environment, and associated to a first virtual character having a first view direction towards a virtual object in the virtual environment; simultaneous with the providing the first view, providing a second view of the virtual environment to a second HMD, the second view being defined from the first location in the virtual environment, and associated to a second virtual character in the virtual environment; wherein providing the second view includes rendering the first virtual character in the second view, the rendering of the first virtual character in the second view being configured to present the first virtual character as having a second location in the virtual environment, the rendering of the first virtual character in the second view being further configured to present the first virtual

Abstract: A game controller includes an image capture unit; a body; at least one input device assembled with the body, the input device manipulable by a user to register an input from the user; an inertial sensor operable to produce information for quantifying a movement of said body through space; and at least one light source assembled with the body; and a processor coupled to the image capture unit and the inertial sensor. The processor is configured to track the body by analyzing a signal from the inertial sensor and analyzing an image of the light source from the image capture unit. The processor is configured to establish a gearing between movement of the body and actions to be applied by a computer program.

Abstract: A system for performing a pinch and hold gesture is described. The system includes a head-mounted display (HMD) and a glove, which is worn by a hand of the user. Each finger segment of the glove includes a sensor for detecting positions of the finger segment when moved by the hand. The system includes a computing device interfaced with the HMD and the glove. The computing device analyzes data from the sensors of the finger segments to determine that a pinch and hold gesture is performed by at least two of the finger segments. Moreover, the computing device generates image data that is communicated to the HMD, such that a scene rendered on the HMD is modified to render a visual cue indicative of a location in the scene at which the pinch and hold gesture is associated.

Abstract: Methods for real time motion capture for controlling an object in a video game are provided. One method includes defining a model of a control object and identifying a marker on the control object. The method also includes capturing movement associated with the control object with a video capture device. Then, interpreting the movement associated with the control object to change a position of the model based on data captured through the video capture device, wherein the data captured includes the marker. The method includes moving the video game object presented on the display screen in substantial real-time according to the change of position of the model.

Abstract: A controller provides inputs to control execution of a program by combining controller input information and supplementary information utilizing a value of a first one of the controller input information or the supplementary input information as a modifying input to the game program for modifying a mapping or gearing of an input controlling a still active function activated in accordance with at least one of a second one of the controller input information or the supplementary input information or vice versa. It is emphasized that this abstract is provided to comply with the rules requiring an abstract that will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or meaning of the claims.

Abstract: Methods for real time motion capture for control of a video game character is provided. In one embodiment, a method initiates with defining a model of a control object. Then, a location of a marker on the model is identified. Next, movement associated with the control object is captured. Then, the movement associated with the control object is interpreted to change a position of the model. Next, movement of the character being presented on the display screen is controlled according to the change of position of the model. A computer readable media and a processing system enabling control of video character through real time motion capture are also provided.

Abstract: An apparatus for capturing image and sound during interactivity with a computer game in a game environment is provided. The apparatus includes a housing and a base stand for supporting the housing. An image capture device is defined along a front portion of the housing. Also, an array of microphones is defined along the front portion of the housing. The array of microphones is defined by a single microphone positioned on a first lateral side of the image capture device and two or more microphones positioned on a second lateral side of the image capture device opposite the first side. The apparatus also includes a connector for connecting to a computing device.

Abstract: Sound processing methods and apparatus are provided. A sound capture unit is configured to identify one or more sound sources. The sound capture unit generates data capable of being analyzed to determine a listening zone at which to process sound to the substantial exclusion of sounds outside the listening zone. Sound captured and processed for the listening zone may be used for interactivity with the computer program. The listening zone may be adjusted based on the location of a sound source. One or more listening zones may be pre-calibrated. The apparatus may optionally include an image capture unit configured to capture one or more image frames. The listening zone may be adjusted based on the image. A video game unit may be controlled by generating inertial, optical and/or acoustic signals with a controller and tracking a position and/or orientation of the controller using the inertial, acoustic and/or optical signal.