Abstract: 2D and 3D data of a scene are linked by associating points in the 3D data with corresponding points in multiple different 2D images within the 2D data. Labels assigned to points in either data can be propagated to the other data. Labels propagated to a point in the 3D data are aggregated, and the labels ranked highest are kept and propagated back to the 2D images. 3D data including labels produced in this manner allow partially obscured objects in certain views to be more accurately identified. Thus, an object can be manipulated in all 2D views of the 2D data in which the object is at least partially visible, in order to digitally remove, alter, or replace it.

Abstract: Touchscreen-enabled devices are provided to display images of either real or virtual environments, the devices having at least one user interface including a graphical overlay laid over the images for navigating the environments. The device can interpret gestures made by a single finger of the user on the touchscreen as commands to achieve intended maneuvers such as translations of the point of view and rotations of the point of view within the displayed environment. This allows for one-finger navigation of the environment. The elevational angle of the viewpoint may be tilted above or below horizontal as the viewpoint approaches topographical features within the displayed environment, and may return to horizontal after transitioning to a level surface.

Abstract: Systems and method of mapping spaces include a head-mounted sensor array. The array includes sensors configured to both measure distances within spaces and capture images of the spaces. This data may be used to generate continuously navigable virtual simulations of the spaces. Mapping of the spaces may include movable objects such as doors, transparent objects such as windows, and transitions between floors.

Abstract: Touchscreen-enabled devices are provided to display images of either real or virtual environments, the devices having at least one user interface including a graphical overlay laid over the images for navigating the environments. The device can interpret gestures made by a single finger of the user on the touchscreen as commands to achieve intended maneuvers such as translations of the point of view and rotations of the point of view within the displayed environment. This allows for one-finger navigation of the environment. The elevational angle of the viewpoint may be tilted above or below horizontal as the viewpoint approaches topographical features within the displayed environment, and may return to horizontal after transitioning to a level surface.

Abstract: Systems and methods are provided for calibrating eye tracking systems. Eye tracking to objects at known locations allow for the determination of a new calibration. Systems and methods are also provided for controlling human-machine interfaces by gaze gestures based on changes in eye vergence. Visual aids for training to use eye vergence to controls and for other purposes are also provided.

Abstract: Touchscreen-enabled devices are provided to display images of either real or virtual environments, the devices having user interfaces including a graphical overlay laid over the images for navigating the environments. The device can interpret gestures made by the user on the touchscreen as commands, and the graphical overlay guides the user as to where to make the gestures to achieve intended maneuvers such as translations of the point of view and rotations of the point of view within the displayed environment. The graphical overlay can comprise only a single symbol, and gestures that originate within the area of the display marked by the symbol are differentiated from those gestures originating from outside of the symbol, where the differentiated gestures control translation and rotation, respectively. This allows for one-finger navigation of the environment.

Abstract: Systems and methods are provided that allow a person to exert control in real space as well as in virtual spaces. Eye tracking is employed to determine the direction of the viewer's gaze, and head tracking can be used as needed to track the viewer's head in order to provide a stable virtual environment. Eye vergence can then be used to as a triggering mechanism to initiate responses stored in association with objects in the field of view. Additionally, eye vergence can be used to provide a continuous control.

Abstract: Systems and method of mapping spaces include a head-mounted sensor array. The array includes sensors configured to both measure distances within spaces and capture images of the spaces. This data may be used to generate continuously navigable virtual simulations of the spaces. Mapping of the spaces may include movable objects such as doors, transparent objects such as windows, and transitions between floors.

Abstract: Touchscreen-enabled devices are provided to display images of either real or virtual environments, the devices having user interfaces including a graphical overlay laid over the images for navigating the environments. The device can interpret gestures made by the user on the touchscreen as commands, and the graphical overlay guides the user as to where to make the gestures to achieve intended maneuvers such as translations of the point of view and rotations of the point of view within the displayed environment. The graphical overlay can comprise only a single symbol, and gestures that originate within the area of the display marked by the symbol are differentiated from those gestures originating from outside of the symbol, where the differentiated gestures control translation and rotation, respectively. This allows for one-finger navigation of the environment.

Abstract: Systems and method of mapping spaces include a head-mounted sensor array. The array includes sensors configured to both measure distances within spaces and capture images of the spaces. This data may be used to generate continuously navigable virtual simulations of the spaces. Mapping of the spaces may include movable objects such as doors, transparent objects such as windows, and transitions between floors.

Abstract: Systems and method of mapping spaces include a head-mounted sensor array. The array includes sensors configured to both measure distances within spaces and capture images of the spaces. This data may be used to generate continuously navigable virtual simulations of the spaces. Mapping of the spaces may include movable objects such as doors, transparent objects such as windows, and transitions between floors.

Abstract: Systems and methods are provided that allow a person to exert control in real space as well as in virtual spaces. Eye tracking is employed to determine the direction of the viewer's gaze, and head tracking can be used as needed to track the viewer's head in order to provide a stable virtual environment. Eye vergence can then be used to as a triggering mechanism to initiate responses stored in association with objects in the field of view. Additionally, eye vergence can be used to provide a continuous control.