Abstract: A method for depth mapping includes projecting a pattern of optical radiation onto an object. A first image of the pattern on the object is captured using a first image sensor, and this image is processed to generate pattern-based depth data with respect to the object. A second image of the object is captured using a second image sensor, and the second image is processed together with another image to generate stereoscopic depth data with respect to the object. The pattern-based depth data is combined with the stereoscopic depth data to create a depth map of the object.

Abstract: A 3D face reconstruction technique using 2D images, such as photographs of a face, is described. Prior face knowledge or a generic face is used to extract sparse 3D information from the images and to identify image pairs. Bundle adjustment is carried out to determine more accurate 3D camera positions, image pairs are rectified, and dense 3D face information is extracted without using the prior face knowledge. Outliers are removed, e.g., by using tensor voting. A 3D surface is extracted from the dense 3D information and surface detail is extracted from the images.

Abstract: A tensor voting scheme which can be used in an arbitrary number N of dimensions, up to several hundreds. The voting scheme can operate on unorganized point inputs, which can be oriented or unoriented, and estimate the intrinsic dimensionality at each point. Moreover it can estimate the tangent and normal space of a manifold passing through each point based solely on local operations.

Abstract: Among other things, methods, systems and computer program products are described for detecting and tracking a moving object in a scene. One or more residual pixels are identified from video data. At least two geometric constraints are applied to the identified one or more residual pixels. A disparity of the one or more residual pixels to the applied at least two geometric constraints is calculated. Based on the detected disparity, the one or more residual pixels are classified as belonging to parallax or independent motion and the parallax classified residual pixels are filtered. Further, a moving object is tracked in the video data. Tracking the object includes representing the detected disparity in probabilistic likelihood models. Tracking the object also includes accumulating the probabilistic likelihood models within a number of frames during the parallax filtering.

Abstract: A 3D face reconstruction technique using 2D images, such as photographs of a face, is described. Prior face knowledge or a generic face is used to extract sparse 3D information from the images and to identify image pairs. Bundle adjustment is carried out to determine more accurate 3D camera positions, image pairs are rectified, and dense 3D face information is extracted without using the prior face knowledge. Outliers are removed, e.g., by using tensor voting. A 3D surface is extracted from the dense 3D information and surface detail is extracted from the images.

Abstract: A 3D face reconstruction technique using 2D images, such as photographs of a face, is described. Prior face knowledge or a generic face is used to extract sparse 3D information from the images and to identify image pairs. Bundle adjustment is carried out to determine more accurate 3D camera positions, image pairs are rectified, and dense 3D face information is extracted without using the prior face knowledge. Outliers are removed, e.g., by using tensor voting. A 3D surface is extracted from the dense 3D information and surface detail is extracted from the images.

Abstract: A 3D face reconstruction technique using 2D images, such as photographs of a face, is described. Prior face knowledge or a generic face is used to extract spars(e 3D information from the images and to identify image pairs. Bundle adjustment is carried out to determine more accurate 3D camera positions, image pairs are rectified, and dense 3D face information is extracted without using the prior face knowledge. Outliers are removed, e.g., by using tensor voting. A 3D surface is extracted from the dense 3D information and surface detail is extracted from the images.

Abstract: A device for carrying out of biometric identification by comparing face shapes. The shape of a first face is compared with the shape of a second face. A map can be determined between the shapes. The shape, and hence the comparison, is substantially independent of pose and lighting, and also parts of the shape can be removed from the comparison in order to enhance the recognition.

Abstract: A system of determining three-dimensional information from the information that is contained into discrete two-dimensional images. The two images may be obtained from two uncalibrated cameras. The information from the two uncalibrated cameras is first rectified, and then used to form a disparity surface indicating the third dimensional information. Various techniques are used to increase the speed of conversion.

Abstract: Three dimensional face recognition via vectorizing samples that are in an enrollment data base. The vectors are formed by comparing faces in the enrollment database with reference faces, and determining differences between the actual faces and the reference faces. Those differences are then formed into an N dimensional vector representing the classified faces. A query face is then similarly vectorized and compared to precomputed vectors indicative of the faces in the database. Another technique is described for updating the reference faces based on an error level.

Abstract: A face recognition device which operates in sunlit conditions such as in sunlight, or in indirect sunlight. The device operates without projection of light or other illumination to the face. Stereo information indicative of the face shape is obtained, and used to construct a 3D model. That model is compared to other models of known faces, and used to verify identity based on the comparison.

Abstract: A device for carrying out of biometric identification by comparing face shapes. The shape of a first face is compared with the shape of a second face. A map can be determined between the shapes. The shape, and hence the comparison, is substantially independent of pose and lighting, and also parts of the shape can be removed from the comparison in order to enhance the recognition.

Abstract: A system of using three-dimensional information as a front and for a two-dimensional image comparison system. The three-dimensional information is obtained that is indicated of a known user's face. This three-dimensional information is used to generate two-dimensional views from different perspectives, including different poses and/or different lighting effects, and used to populate a database of a two-dimensional recognition system. The images are then two-dimensionally recognized using conventional two-dimensional recognition techniques, but this two-dimensional recognition is carried out on an improved database.

Abstract: A virtual PTZ camera is described which forms a virtual image using multiple cameras whose fields of view overlap. Images from the cameras are merged by transforming to a common surface and property-blending overlapping regions to smooth transitions due to differences in image formation of common portions of a scene. To achieve high speed, the images may be merged to a common planar surface or set of surfaces so that transforms can be linear. Image information alone may be used to calculate the transforms from common feature points located in the images so that there is no need for three-dimensional geometric information about the cameras.

Abstract: A system of determining three-dimensional information from the information that is contained into discrete two-dimensional images. The two images may be obtained from two uncalibrated cameras. The information from the two uncalibrated cameras is first rectified, and then used to form a disparity surface indicating the third dimensional information. Various techniques are used to increase the speed of conversion.

Abstract: A method and an apparatus for substituting a representation of a target, identified by a set of points of interest stored in a memory, with a matching representation of a predetermined stored pattern in successive TV frames are described. The apparatus has a buffer for storing successive frames of a sequence, constituting a first in-first out memory having a length sufficient for storing all frames over a period of some seconds. Points of interest in each current frame are extracted and an attempt is made to find at least a subset of the extracted points of interest matching with a respective subset of the stored set. Global motion of the image between successive frames is evaluated and the location of the target in the frames following and preceding a frame in which the pattern is found is predicted. A target finder locates the target in the frames where it is found, based on the prediction.