Abstract: The present invention discloses a system to achieve a massive multiplayer online real-time interaction, where the sound that is projected into a public arena, through the local multimedia system, will be the composition of all the sound contributions send by each remote user that are participating in the event and that will get the return feedback through the event broadcast.

Abstract: A computer implemented method for incorporating a representation of a participant into a virtual 3D environment substantially in real-time is provided. An image including a participant is captured by a camera. A contour of the participant is automatically determined. Depth data is automatically associated with the participant contour. A first virtual 3D representation of the participant is automatically generated by extruding the participant contour based on the associated depth data. An interaction between the first virtual 3D representation of the participant and a second virtual 3D representation of a second object is displayed.

Abstract: Various apparatus and methods are described for a simulation and/or user interface environment. Image data and actual measured depth data of a real object from a real-world scene is acquired via one or more sensors. There is matching of the resolution of the image data and actual measured depth data as well as a linking formed between the image data and actual measured depth data for each pixel representing the real-world object in the scene. The actual measured depth data of the real-world object is processed to extract normal vector data to the surface of the real-world object. occlusion, lighting, and any physics-based interaction effects are based on at least the image data and actual measured depth data.

Abstract: A computer implemented method for processing video is provided. A first image and a second image are captured by a camera. A feature present in the first camera image and the second camera image is identified. A first location value of the feature within the first camera image is identified. A second location value of the feature within the second camera image is identified. An intermediate location value of the feature based at least in part on the first location value and the second location value is determined. The intermediate location value and the second location value are communicated to a physics simulation.

Abstract: A computer implemented method for inputting transient data into a persistent world is provided. The method includes capturing sensor data from a sensor. The method further includes detecting a condition, wherein the detection is based at least in part on the match of a detection criteria from a database of a plurality of detection criteria to the captured sensor data. The method includes interpreting the detected condition, wherein the interpretation is based at least in part on the match of an interpretation criteria from a database of a plurality of interpretation criteria to the detected condition. And, the method includes registering the interpretation of the detected condition with a virtual object in a simulation.

Abstract: A computer implemented method for incorporating a representation of a participant into a virtual 3D environment substantially in real-time is provided. An image including a participant is captured by a camera. A contour of the participant is automatically determined. Depth data is automatically associated with the participant contour. A first virtual 3D representation of the participant is automatically generated by extruding the participant contour based on the associated depth data. An interaction between the first virtual 3D representation of the participant and a second virtual 3D representation of a second object is displayed.