Abstract: A depth sculpturing system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. The depth sculpturing system further includes a user input device. Execution of programming by a processor configures the depth sculpturing system to perform functions to track, via the user input device, motion of a two-dimensional input selection from an initial touch point to a final touch point. The depth sculpturing system determines a rotation matrix between an initial ray and a final ray that project to the initial touch point and the final touch point, correspondingly. The depth sculpturing system generates a depth sculptured image by applying the rotation matrix to vertices of an initial depth image. The depth sculpturing system presents, via an image display, the depth sculptured image.

Abstract: A virtual shockwave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual shockwave creation system to generate, for each of multiple initial depth images, a respective shockwave image by applying a transformation function to the initial three-dimensional coordinates. The virtual shockwave creation system creates a warped shockwave video including a sequence of the generated warped shockwave images. The virtual shockwave creation system presents, via an image display, the warped shockwave video.

Abstract: A depth sculpturing system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. The depth sculpturing system further includes a user input device. Execution of programming by a processor configures the depth sculpturing system to perform functions to track, via the user input device, motion of a two-dimensional input selection from an initial touch point to a final touch point. The depth sculpturing system determines a rotation matrix between an initial ray and a final ray that project to the initial touch point and the final touch point, correspondingly. The depth sculpturing system generates a depth sculptured image by applying the rotation matrix to vertices of an initial depth image. The depth sculpturing system presents, via an image display, the depth sculptured image.

Abstract: A wallpaper system presents a first wallpaper image of a wallpaper video to a user and receives, via a user input device, one or both of: (i) a spatial user input selection, and (ii) a time user input selection from the user to apply to the wallpaper video. In response to detecting one or both of: (i) the spatial user input selection, and (ii) the time user input selection, the wallpaper system determines one or both of: (i) a respective spatial movement parameter within a wallpaper video associated with the spatial user input selection, and (ii) a respective time coordinate within the wallpaper video associated with the time user input selection. Wallpaper system presents, via the image display, a second wallpaper image associated with one or both of: (i) the respective spatial movement parameter, and (ii) the respective time coordinate.

Abstract: Three-dimensional image calibration and presentation for eyewear including a pair of image capture devices is described. Calibration and presentation includes obtaining a calibration offset to accommodate flexure in the support structure for the eyewear, adjusting a three dimensional rendering offset by the obtained calibration offset, and presenting the stereoscopic images using the three dimension rendering offset.

Abstract: Systems and methods for determining disparity between two images are disclosed. Such systems and methods include obtaining a first raw pixel image of a scene from a first viewpoint, obtaining a second raw image of the scene from a second viewpoint (e.g.

Abstract: A depth sculpturing system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. The depth sculpturing system further includes a user input device. Execution of programming by a processor configures the depth sculpturing system to perform functions to track, via the user input device, motion of a two-dimensional input selection from an initial touch point to a final touch point. The depth sculpturing system determines a rotation matrix between an initial ray and a final ray that project to the initial touch point and the final touch point, correspondingly. The depth sculpturing system generates a depth sculptured image by applying the rotation matrix to vertices of an initial depth image. The depth sculpturing system presents, via an image display, the depth sculptured image.

Abstract: A virtual shockwave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual shockwave creation system to generate, for each of multiple initial depth images, a respective shockwave image by applying a transformation function to the initial three-dimensional coordinates. The virtual shockwave creation system creates a warped shockwave video including a sequence of the generated warped shockwave images. The virtual shockwave creation system presents, via an image display, the warped shockwave video.

Abstract: Embodiments are disclosed that relate to interacting with a graphical user interface in a manner to facilitate hands-free operation. For example, one disclosed embodiment provides a method including outputting to a display device a user interface that displays graphical representations of a plurality of alignable user interface objects, each alignable user interface object representing a selectable object. The method further includes receiving depth data from an imaging device, the image data capturing an image of a face directed toward the display device. The method further comprises changing an alignment condition of a first user interface object of the plurality of alignable user interface objects to move the first user interface object into an aligned condition, and changing an alignment condition of a second user interface object to move the second user interface object out of an aligned condition based on the received image data.

Abstract: A 3D imager comprising two cameras having fixed wide-angle and narrow angle FOVs respectively that overlap to provide an active space for the imager and a controller that determines distances to features in the active space responsive to distances provided by the cameras and a division of the active space into near, intermediate, and far zones.

Abstract: A method for authenticating a user. The method includes the act of recording first data about an environment at a first time. A user interaction with the environment is stored as a stored password. Second data about the environment is received through an image sensor at a second time. While receiving the second data about the environment, a password is entered. The entered password is compared with the stored password.

Abstract: An eye movement tracking device that can be mounted to standard eyeglasses as disclosed. The device comprises an illumination source, a time-of-flight (TOF) camera and a processor. The source transmits energy within a frequency band from a location proximate to an eye of a person, such that at least a first portion of the transmitted energy is reflected off a lens of eyewear worn by the person to subsequently reflect off the eye, and such that at least a second portion of the transmitted energy is transmitted through the lens to reflect off objects in the person's environment. The TOF camera detects reflections of at least the first portion of the transmitted energy, and distinguishes them from other energy detected by the TOF camera in said frequency band, based on TOF principles. The processor uses the detected reflections of the first portion of the transmitted energy to determine eye position.

Abstract: A system for controlling infrared (IR) enabled devices by projecting coded IR pulses from an active illumination depth camera is described. In some embodiments, a gesture recognition system includes an active illumination depth camera such as a depth camera that utilizes time-of-flight (TOF) or structured light techniques for obtaining depth information. The gesture recognition system may detect the performance of a particular gesture associated with a particular electronic device, determine a set of device instructions in response to detecting the particular gesture, and transmit the set of device instructions to the particular electronic device utilizing coded IR pulses. The coded IR pulses may imitate the IR pulses associated with a remote control protocol. In some cases, the coded IR pulses transmitted may also be used by the active illumination depth camera for determining depth information.

Abstract: A wearable apparatus configured to acquire zoom images of a portion of an environment viewed by a user responsive to determining a point of regard of the user.

Abstract: An eye movement tracking device that can be mounted to standard eyeglasses as disclosed. The device comprises an illumination source, a time-of-flight (TOF) camera and a processor. The source transmits energy within a frequency band from a location proximate to an eye of a person, such that at least a first portion of the transmitted energy is reflected off a lens of eyewear worn by the person to subsequently reflect off the eye, and such that at least a second portion of the transmitted energy is transmitted through the lens to reflect off objects in the person's environment. The TOF camera detects reflections of at least the first portion of the transmitted energy, and distinguishes them from other energy detected by the TOF camera in said frequency band, based on TOF principles. The processor uses the detected reflections of the first portion of the transmitted energy to determine eye position.

Abstract: An eye movement tracking device that can be mounted to standard eyeglasses as disclosed. The device comprises an illumination source, a time-of-flight (TOF) camera and a processor. The source transmits energy within a frequency band from a location proximate to an eye of a person, such that at least a first portion of the transmitted energy is reflected off a lens of eyewear worn by the person to subsequently reflect off the eye, and such that at least a second portion of the transmitted energy is transmitted through the lens to reflect off objects in the person's environment. The TOF camera detects reflections of at least the first portion of the transmitted energy, and distinguishes them from other energy detected by the TOF camera in said frequency band, based on TOF principles. The processor uses the detected reflections of the first portion of the transmitted energy to determine eye position.

Abstract: Embodiments are disclosed that relate to interacting with a graphical user interface in a manner to facilitate hands-free operation. For example, one disclosed embodiment provides a method including outputting to a display device a user interface that displays graphical representations of a plurality of alignable user interface objects, each alignable user interface object representing a selectable object. The method further includes receiving depth data from an imaging device, the image data capturing an image of a face directed toward the display device. The method further comprises changing an alignment condition of a first user interface object of the plurality of alignable user interface objects to move the first user interface object into an aligned condition, and changing an alignment condition of a second user interface object to move the second user interface object out of an aligned condition based on the received image data.

Abstract: A method and system that enhances a user's experience when using a near eye display device, such as a see-through display device or a head mounted display device is provided. The user's intent to interact with one or more objects in the scene is determined. An optimized image is generated for the user based on the user's intent. The optimized image is displayed to the user, via the see-through display device. The optimized image visually enhances the appearance of objects that the user intends to interact with in the scene and diminishes the appearance of objects that the user does not intend to interact with in the scene. The optimized image can visually enhance the appearance of the objects that increase the user's comprehension. The optimized image is displayed to the user, via the see-through display device.

Abstract: Embodiments are disclosed that relate to calibrating an eye tracking system for a computing device. For example, one disclosed embodiment provides, in a computing device comprising a gaze estimation system, a method of calibrating the gaze estimation system. The method includes receiving a request to log a user onto the computing device, outputting a passcode entry display image to a display device, receiving image data from one or more eye tracking cameras, and from the image data, determining a gaze scanpath representing a path of a user's gaze on the passcode entry display image. The method further includes comparing the gaze scanpath to a stored scanpath for the user, and calibrating the gaze estimation system based upon a result of comparing the gaze scanpath to the stored scanpath for the user.

Abstract: An embodiment of the invention provides a three dimensional biometric identification system (3D-BIS) comprising a head mounted 3D-range camera that acquires a 3D range image and a picture image of a biometric hand identifier of a wearer of the 3D range camera and uses the images to find a match with a biometric hand identifier associated with a person having a known identity to provide an identity for the wearer.