Abstract: Techniques are provided for determining depth to objects. A depth image may be determined based on two light intensity images. This technique may compensate for differences in reflectivity of objects in the field of view. However, there may be some misalignment between pixels in the two light intensity images. An iterative process may be used to relax a requirement for an exact match between the light intensity images. The iterative process may involve modifying one of the light intensity images based on a smoothed version of a depth image that is generated from the two light intensity images. Then, new values may be determined for the depth image based on the modified image and the other light intensity image. Thus, pixel misalignment between the two light intensity images may be compensated.

Abstract: A method for determining an optimal location for positioning an image capturing device within a volume, the method including, obtaining a plurality of points to be visible from the image capturing device, performing inversion on points located in the vicinity of the plurality of points thus creating a computerized inversed object, each point in the vicinity of the plurality of point is translated to a corresponding point in the computerized inversed object, defining a convex hull of the inversed object, determining if a point of the plurality of points is visible from the viewpoint according to the position of its corresponding point on the convex hull relative to its neighbor points, repeating said determining for multiple locations within the volume, determining whether a predetermined set of points is visible from each location, selecting the optimal location of the image capturing device based on the results of said repeated determining.

Abstract: An imaging system comprising: a light source for illuminating a scene with a known intensity light; a camera having an optic axis and center that images the scene responsive to light reflected by the scene from the illuminating, known intensity light; a range finder controllable to determine distances to surface elements of the scene imaged by the camera; a controller configured to determine reflectivity of a surface element of the scene imaged by the camera responsive to a distance of the surface element from the camera, the known intensity of illuminating light and light from the surface element imaged by the camera.

Abstract: A method of interfacing a person with a computer, the method comprising: providing the person with a device having: a shaft having an axis; a tsuba connected to the shaft and having a first side that extends away from the axis and faces the shaft; and a handgrip on a second side of the tsuba opposite the first side; acquiring an image of the device; determining an orientation of the device responsive to the image; and generating an action by the computer responsive to the orientation.

Abstract: A computing system generates a depth map from at least one image, detects objects in the depth map, and identifies anomalies in the objects from the depth map. Another computing system identifies at least one anomaly in an object in a depth map, and uses the anomaly to identify future occurrences of the object. A system includes a three dimensional (3D) imaging system to generate a depth map from at least one image, an object detector to detect objects within the depth map, and an anomaly detector to detect anomalies in the detected objects, wherein the anomalies are logical gaps and/or logical protrusions in the depth map.

Abstract: A depth-mapping method comprises exposing first and second detectors oriented along different optical axes to light dispersed from a scene, and furnishing an output responsive to a depth coordinate of a locus of the scene. The output increases with an increasing first amount of light received by the first detector during a first period, and decreases with an increasing second amount of light received by the second detector during a second period different than the first.

Abstract: Compatibility between a depth image consumer and a plurality of different depth image producers is provided by receiving a native depth image having unsupported depth camera parameters that are not compatible with a depth image consumer, and converting the native depth image to a virtual depth image having supported virtual depth camera parameters that are compatible with the depth image consumer. This virtual depth image is then output to the depth image consumer.

Abstract: A video projector device includes a visible light projector to project an image on a surface or object, and a visible light sensor, which can be used to obtain depth data regarding the object using a time-of-flight principle. The sensor can be a charge-coupled device which obtains color images as well as obtaining depth data. The projected light can be provided in successive frames. A frame can include a gated sub-frame of pulsed light followed by continuous light, while the sensor is gated, to obtain time of flight data, an ungated sub-frame of pulsed light followed by continuous light, while the sensor is ungated, to obtain reflectivity data and a background sub-frame of no light followed by continuous light, while the sensor is gated, to determine a level of background light. A color sub-frame projects continuous light, while the sensor is active.

Abstract: Embodiments are disclosed that relate to calibrating an eye tracking system for a computing device. For example, one disclosed embodiment provides, in a computing device comprising a gaze estimation system, a method of calibrating the gaze estimation system. The method includes receiving a request to log a user onto the computing device, outputting a passcode entry display image to a display device, receiving image data from one or more eye tracking cameras, and from the image data, determining a gaze scanpath representing a path of a user's gaze on the passcode entry display image. The method further includes comparing the gaze scanpath to a stored scanpath for the user, and calibrating the gaze estimation system based upon a result of comparing the gaze scanpath to the stored scanpath for the user.

Abstract: Systems and methods for increasing the resolution of a depth map by identifying and updating false depth pixels are described. In some embodiments, a depth pixel of the depth map is initially assigned a confidence value based on curvature values and localized contrast information. The curvature values may be generated by applying a Laplacian filter or other edge detection filter to the depth pixel and its neighboring pixels. The localized contrast information may be generated by determining a difference between the maximum and minimum depth values associated with the depth pixel and its neighboring pixels. A false depth pixel may be identified by comparing a confidence value associated with the false depth pixel with a particular threshold. The false depth pixel may be updated by assigning a new depth value based on an extrapolation of depth values associated with neighboring pixel locations.

Abstract: Techniques are provided for determining depth to objects. A depth image may be determined based on two light intensity images. This technique may compensate for differences in reflectivity of objects in the field of view. However, there may be some misalignment between pixels in the two light intensity images. An iterative process may be used to relax a requirement for an exact match between the light intensity images. The iterative process may involve modifying one of the light intensity images based on a smoothed version of a depth image that is generated from the two light intensity images. Then, new values may be determined for the depth image based on the modified image and the other light intensity image. Thus, pixel misalignment between the two light intensity images may be compensated.

Abstract: Compatibility between a depth image consumer and a depth image producer is provided by receiving a native depth image having an unsupported type that is not supported by a depth image consumer, and processing the native depth image into an emulation depth image having a supported type that is supported by the depth image consumer. This emulation depth image is then output to the depth image consumer.

Abstract: A method for determining an optimal location for positioning an image capturing device within a volume, the method including, obtaining a plurality of points to be visible from the image capturing device, performing inversion on points located in the vicinity of the plurality of points thus creating a computerized inversed object, each point in the vicinity of the plurality of point is translated to a corresponding point in the computerized inversed object, defining a convex hull of the inversed object, determining if a point of the plurality of points is visible from the viewpoint according to the position of its corresponding point on the convex hull relative to its neighbor points, repeating said determining for multiple locations within the volume, determining whether a predetermined set of points is visible from each location, selecting the optimal location of the image capturing device based on the results of said repeated determining.

Abstract: Techniques are provided for determining depth to objects. A depth image may be determined based on two light intensity images. This technique may compensate for differences in reflectivity of objects in the field of view. However, there may be some misalignment between pixels in the two light intensity images. An iterative process may be used to relax a requirement for an exact match between the light intensity images. The iterative process may involve modifying one of the light intensity images based on a smoothed version of a depth image that is generated from the two light intensity images. Then, new values may be determined for the depth image based on the modified image and the other light intensity image. Thus, pixel misalignment between the two light intensity images may be compensated.

Abstract: The subject matter discloses a method of determining whether a point in a computerized image is visible from a viewpoint; said image is represented as a point cloud, the method comprising: performing inversion on a the vicinity of the point thus creating a computerized inversed object, each point in the vicinity of the point is related to a parallel point in the computerized inversed object and obtaining a convex hull of the inversed object; the point is likely to be visible from the viewpoint in case it belongs to the point set composing the convex hull. The method is also useful for shadow casting and for determining the location of an image-capturing device within a volume.

Abstract: Techniques are provided for de-aliasing depth images. The depth image may have been generated based on phase differences between a transmitted and received modulated light beam. A method may include accessing a depth image that has a depth value for a plurality of locations in the depth image. Each location has one or more neighbor locations. Potential depth values are determined for each of the plurality of locations based on the depth value in the depth image for the location and potential aliasing in the depth image. A cost function is determined based on differences between the potential depth values of each location and its neighboring locations. Determining the cost function includes assigning a higher cost for greater differences in potential depth values between neighboring locations. The cost function is substantially minimized to select one of the potential depth values for each of the locations.

Abstract: A 3D imager comprising two cameras having fixed wide-angle and narrow angle FOVs respectively that overlap to provide an active space for the imager and a controller that determines distances to features in the active space responsive to distances provided by the cameras and a division of the active space into near, intermediate, and far zones.

Abstract: A system for controlling infrared (IR) enabled devices by projecting coded IR pulses from an active illumination depth camera is described. In some embodiments, a gesture recognition system includes an active illumination depth camera such as a depth camera that utilizes time-of-flight (TOF) or structured light techniques for obtaining depth information. The gesture recognition system may detect the performance of a particular gesture associated with a particular electronic device, determine a set of device instructions in response to detecting the particular gesture, and transmit the set of device instructions to the particular electronic device utilizing coded IR pulses. The coded IR pulses may imitate the IR pulses associated with a remote control protocol. In some cases, the coded IR pulses transmitted may also be used by the active illumination depth camera for determining depth information.

Abstract: Systems and methods for increasing the resolution of a depth map by identifying and updating false depth pixels are described. In some embodiments, a depth pixel of the depth map is initially assigned a confidence value based on curvature values and localized contrast information. The curvature values may be generated by applying a Laplacian filter or other edge detection filter to the depth pixel and its neighboring pixels. The localized contrast information may be generated by determining a difference between the maximum and minimum depth values associated with the depth pixel and its neighboring pixels. A false depth pixel may be identified by comparing a confidence value associated with the false depth pixel with a particular threshold. The false depth pixel may be updated by assigning a new depth value based on an extrapolation of depth values associated with neighboring pixel locations.

Abstract: A depth-mapping method comprises exposing first and second detectors oriented along different optical axes to light dispersed from a scene, and furnishing an output responsive to a depth coordinate of a locus of the scene. The output increases with an increasing first amount of light received by the first detector during a first period, and decreases with an increasing second amount of light received by the second detector during a second period different than the first.