Abstract: Methods and systems for dynamic virtual convergence (218) and a video see through head mountable display (200) that uses dynamic virtual convergence are disclosed. A dynamic virtual convergence algorithm (218) includes sampling an image with two cameras. The cameras each have a field of view that is larger than a field of view of displays used to display images sampled by the cameras (210). A heuristic is used to estimate the gaze distance of the viewer. The display frustums are transformed so that they converge at the estimated gaze distance. The images sampled by the cameras (210) are then reprojected into the transformed display frustums. The reprojected images are displayed to the user to simulate viewing of close range objects.

Abstract: A real-time structured light depth extraction system includes a projector for projecting structured light patterns onto an object of interest. A camera positioned off-axis from the projector samples light reflected from the object synchronously with the projection of structured light patterns and outputs digital signals indicative of the reflected light. An image processor/controller receives the digital signals from the camera and processes the digital signals to extract depth information of the object in real time.

Abstract: Systems, methods and computer program products which have the registration accuracy of vision-based tracking systems and the robustness of magnetic tracking systems. Video tracking of landmarks is utilized as the primary method for determining camera position and orientation but is enhanced by magnetic or other forms of physical tracking camera movement and orientation. A physical tracker narrows the landmark search area on images, speeding up the landmark search process. Information from the physical tracker may also be used to select one of several solutions of a non-linear equation resulting from the vision-based tracker. The physical tracker may also act as a primary tracker if the image analyzer cannot locate enough landmarks to provide proper registration, thus, avoiding complete loss of registration. Furthermore, if 1 or 2 landmarks (not enough for a unique solution) are detected, several may be utilized heuristic methods are used to minimize registration loss.