Abstract: A Spatial Operating Environment (SOE) with markerless gestural control includes a sensor coupled to a processor that runs numerous applications. A gestural interface application executes on the processor. The gestural interface application receives data from the sensor that corresponds to a hand of a user detected by the sensor, and tracks the hand by generating images from the data and associating blobs in the images with tracks of the hand. The gestural interface application detects a pose of the hand by classifying each blob as corresponding to an object shape. The gestural interface application generates a gesture signal in response to a gesture comprising the pose and the tracks, and controls the applications with the gesture signal.

Abstract: The system of direct interaction between one or more subjects and at least one image and/or a video with dynamic effect projected onto an interactive surface includes an interactive station. The interactive station includes an integrated apparatus for the acquisition and processing of the information detected in the interactive area, and a covering shaped like a box able to be fixed on a surface perpendicular with respect to the interactive area in which the natural action of the person and the interaction between the person and at least one image projected by the projector is carried out. The interactive station of the wireless type incorporates a PC control unit, infra-red ray generators, and at least one video camera with a firewire card. The method of direct interaction includes managing the interactive system, managing networking and physical alignment, selecting interactive effects, tracing statistics, and performing a cluster function.