Abstract: A method of operating a mobile device with a camera, a display and a position sensor to provide a display of supplementary information aligned with a view of a scene. One or more image obtained from the camera is uploaded to a remote server together with corresponding data from the position sensor. Image processing is then performed to track image motion between that image and subsequent images obtained from the camera, determining a mapping between the uploaded image and a current image. Data is then received via the network indicative of a pixel location for display of supplementary information within the reference image. The mapping is used to determine a corresponding pixel location for display of the supplementary information within the current image, and the supplementary information is displayed on the display correctly aligned with the view of the scene.

Abstract: In accordance with one embodiment, a method to track persons includes generating a first and second set of facial coefficient vectors by: (i) providing a first and second image containing a plurality of persons; (ii) locating faces of persons in each image; and (iii) generating a facial coefficient vector for each face by extracting from the images coefficients sufficient to locally identify each face, then tracking the persons within the images, the tracking including comparing the first set of facial coefficient vectors to the second set of facial coefficient vectors to determine for each person in the first image if there is a corresponding person in the second image. Optically the method includes using estimated locations in combination with the vector distance between facial coefficient vectors to track persons.

Abstract: A dual field of view (FOV) image is generated as a combination of a small footprint image and large footprint image, where the large footprint image is generated based on rendering to the current viewpoint at least a first image captured relatively farther away from a target so as to appear as a continuation of a small footprint image which is relatively closer to the target. Preferably, both the first image and the small footprint image are captured with the same fixed narrow field of view (NFOV) imaging device. The system is able to operate in real time, using a variety of image capture devices, and provides the benefits of both NFOV and wide FOV (WFOV) without limitations of conventional techniques, including operation at a longer range from a target, with higher resolution, while innovative processing of the captured images provides orientation information via a dual FOV image.

Abstract: Substantially removing shadows in video images obtained from a camera viewing a scene, at variable pointing angles and magnification, by digital processing of a sequence of frames in the video signal, the processing including—(a) creating and maintaining a model image of the scene, by accumulating image data from a plurality of video frames; (b) in the model image, detecting and defining model shadow zones; (c) calculating correction factors for the model shadow zones; (d) for each frame of the video signal—defining, in the image carried by the signal, shadow zones that correspond to respective model shadow zones; and (e) correcting video signal values in shadow zones accordingly.

Abstract: A method for identifying an object based at least in part on a reference database including two-dimensional images of objects includes the following steps: (a) providing a three-dimensional model reference database containing a plurality of estimated three-dimensional models, wherein each estimated three-dimensional model is derived from a corresponding two-dimensional image from the two-dimensional reference database; (b) sampling at least one image of an object to be identified; (c) implementing at least one identification process to identify the object, the identification process employing data from the three-dimensional model reference database.

Abstract: A system and method for detection, tracking, classification, and/or identification of a moving object from a moving sensor uses a three-dimensional (3D) model. The system facilitates generation of a 3D model using images from a variety of sensors, in particular passive two-dimensional (2D) image capture devices. 2D images are processed to determine viewpoint and find moving objects in the 2D images. Conventional techniques or an innovative technique can be used to find segments of 2D images having moving objects. Viewpoint and segment information is used for generation of a 3D model of an object, in particular using both object motion and sensor motion to generate the 3D model.

Abstract: A method of operating a mobile device with a camera, a display and a position sensor to provide a display of supplementary information aligned with a view of a scene. One or more image obtained from the camera is uploaded to a remote server together with corresponding data from the position sensor. Image processing is then performed to track image motion between that image and subsequent images obtained from the camera, determining a mapping between the uploaded image and a current image. Data is then received via the network indicative of a pixel location for display of supplementary information within the reference image. The mapping is used to determine a corresponding pixel location for display of the supplementary information within the current image, and the supplementary information is displayed on the display correctly aligned with the view of the scene.

Abstract: A system for providing a spatially aligned head-up display to a user viewing a scene through a display the system includes: an image sensing system including at least one image sensor deployed to sample images of the user's face, the image sensing system generating data derived at least in part from the images; a display for displaying visible indications to the user superimposed on the scene; and a control system associated with the image sensing system and the display, the control system being configured to: process data from the image sensing system to determine a position and attitude of the user's face, determine a viewing direction from at least one eye of the user to a point of interest within the scene, and actuate the display to display a visible indication aligned with the viewing direction that provides a spatially aligned head-up display to the user.

Abstract: In accordance with one embodiment, a method to track persons includes generating a first and second set of facial coefficient vectors by: (i) providing a first and second image containing a plurality of persons; (ii) locating faces of persons in each image; and (iii) generating a facial coefficient vector for each face by extracting from the images coefficients sufficient to locally identify each face, then tracking the persons within the images, the tracking including comparing the first set of facial coefficient vectors to the second set of facial coefficient vectors to determine for each person in the first image if there is a corresponding person in the second image. Optically the method includes using estimated locations in combination with the vector distance between facial coefficient vectors to track persons.

Abstract: Substantially removing shadows in video images obtained from a camera viewing a scene, at variable pointing angles and magnification, by digital processing of a sequence of frames in the video signal, the processing including—(a) creating and maintaining a model image of the scene, by accumulating image data from a plurality of video frames; (b) in the model image, detecting and defining model shadow zones; (c) calculating correction factors for the model shadow zones; (d) for each frame of the video signal—defining, in the image carried by the signal, shadow zones that correspond to respective model shadow zones; and (e) correcting video signal values in shadow zones accordingly.

Abstract: A method for identifying an object based at least in part on a reference database including two-dimensional images of objects includes the following steps: (a) providing a three-dimensional model reference database containing a plurality of estimated three-dimensional models, wherein each estimated three-dimensional model is derived from a corresponding two-dimensional image from the two-dimensional reference database; (b) sampling at least one image of an object to be identified; (c) implementing at least one identification process to identify the object, the identification process employing data from the three-dimensional model reference database.

Abstract: A system for providing a spatially aligned head-up display to a user viewing a scene through a display the system includes: an image sensing system including at least one image sensor deployed to sample images of the user's face, the image sensing system generating data derived at least in part from the images; a display for displaying visible indications to the user superimposed on the scene; and a control system associated with the image sensing system and the display, the control system being configured to: process data from the image sensing system to determine a position and attitude of the user's face, determine a viewing direction from at least one eye of the user to a point of interest within the scene, and actuate the display to display a visible indication aligned with the viewing direction that provides a spatially aligned head-up display to the user.

Abstract: A system for identifying flash events including an optical imaging module with one or more optical imaging array, the optical imaging module configured for monitoring a region of interest to identify a tentative flash event. The system further includes a ranging module associated with the optical imaging module and configured to derive an estimated range to a location of the tentative flash event, and an acoustic verification module associated with the ranging module and with one or more acoustic sensor. The acoustic verification module is configured to determine whether an acoustic event corresponding to the tentative flash event is detected within a time window derived from the estimated range, thereby classifying the tentative flash event as either a verified flash event or a rejected flash event.

Abstract: A system for identifying flash events including an optical imaging module with one or more optical imaging array, the optical imaging module configured for monitoring a region of interest to identify a tentative flash event. The system further includes a ranging module associated with the optical imaging module and configured to derive an estimated range to a location of the tentative flash event, and an acoustic verification module associated with the ranging module and with one or more acoustic sensor. The acoustic verification module is configured to determine whether an acoustic event corresponding to the tentative flash event is detected within a time window derived from the estimated range, thereby classifying the tentative flash event as either a verified flash event or a rejected flash event.