Abstract: Methods, devices, and computer program products for multi-frame termporal de-noising using image alignment are describe. In one aspect, a method of capturing an image using a multi-frame temporal de-noising is described. The method includes capturing a plurality of frames and aligning the captured plurality of frames with each other. The method further includes determining a subset of frames of the captured plurality of frames, the subset determined based upon a focus quality of each frame of the plurality of frames. Finally, the method includes combining the subset of frames into a single image using a motion filter to reduce blurriness and ghosting.

Abstract: Systems and methods for error correction in structured light are disclosed. In one aspect, a method includes receiving, via a receiver sensor, a structured light image of at least a portion of a composite code mask encoding a plurality of codewords, the image including an invalid codeword. The method further includes detecting the invalid codeword. The method further includes generating a plurality of candidate codewords based on the invalid codeword. The method further includes selecting one of the plurality of candidate codewords to replace the invalid codeword. The method further includes generating a depth map for an image of the scene based on the selected candidate codeword. The method further includes generating a digital representation of a scene based on the depth map. The method further includes outputting the digital representation of the scene to an output device.

Abstract: Certain aspects relate to systems and techniques for performing local intensity equalization on images in a set of images exhibiting local intensity variations. For example, the local intensity equalization can be used to perform accurate region matching and alignment of the images. The images can be partitioned into regions of pixel blocks, for instance based on location, shape, and size of identified keypoints in the images. Regions depicting the same feature in the images can be equalized with respect to intensity. Region matching based on the keypoints in the intensity-equalized regions can be performed with accuracy even in images captured by asymmetric sensors or exhibiting spatially varying intensity.

Abstract: A structured light three-dimensional (3D) depth map based on content filtering is disclosed. In a particular embodiment, a method includes receiving, at a receiver device, image data that corresponds to a structured light image. The method further includes processing the image data to decode depth information based on a pattern of projected coded light. The depth information corresponds to a depth map. The method also includes performing one or more filtering operations on the image data. An output of the one or more filtering operations includes filtered image data. The method further includes performing a comparison of the depth information to the filtered image data and modifying the depth information based on the comparison to generate a modified depth map.

Abstract: A method includes identifying one or more codewords of a bit sequence that fail to satisfy at least one codeword constraint. The method also includes removing the one or more codewords from the bit sequence to generate a punctured bit sequence. The method further includes determining whether the punctured bit sequence is symmetric. The method includes, in response to determining that the punctured bit sequence is symmetric, generating a hermitian symmetric codebook primitive based at least in part on the punctured bit sequence, where the hermitian symmetric codebook primitive is useable to form a diffractive optical element (DOE) of a structured light depth sensing system.

Abstract: A method includes identifying one or more codewords of a bit sequence that fail to satisfy at least one codeword constraint. The method also includes removing the one or more codewords from the bit sequence to generate a punctured bit sequence. The method includes, in response to determining that the punctured bit sequence is symmetric, generating a hermitian symmetric codebook primitive based at least in part on the punctured bit sequence, where the hermitian symmetric codebook primitive is useable to form a diffractive optical element (DOE) of a structured light depth sensing system.

Abstract: A method operational on a transmitter device is provided for projecting a composite code mask. A composite code mask on a tangible medium is obtained, where the composite code mask includes a code layer combined with a carrier layer. The code layer may include uniquely identifiable spatially-coded codewords defined by a plurality of symbols. The carrier layer may be independently ascertainable and distinct from the code layer and includes a plurality of reference objects that are robust to distortion upon projection. At least one of the code layer and carrier layer may be pre-shaped by a synthetic point spread function prior to projection. At least a portion of the composite code mask is projected, by the transmitter device, onto a target object to help a receiver ascertain depth information for the target object with a single projection of the composite code mask.

Abstract: A method for generating codes for a code mask is provided. A plurality of symbols may be arranged into an n1 by n2 symbol structure, where n1 and n2 are integer values. A plurality of codewords may be defined from different overlapping k1 by k2 windows within the symbol structure, wherein co-linear and spatially overlapping windows define unique codewords, and the codewords are unique in a first direction of the symbol structure but are repeated in a second direction that is perpendicular to the first direction. A plurality of the symbol structures as a code mask, wherein symbols in two adjacent k1 by k2 windows are selected so as to avoid codeword aliasing of codewords in the two adjacent k1 by k2 windows.

Abstract: Methods, devices, and computer program products for multi-frame termporal de-noising using image alignment are describe. In one aspect, a method of capturing an image using a multi-frame temporal de-noising is described. The method includes capturing a plurality of frames and aligning the captured plurality of frames with each other. The method further includes determining a subset of frames of the captured plurality of frames, the subset determined based upon a focus quality of each frame of the plurality of frames. Finally, the method includes combining the subset of frames into a single image using a motion filter to reduce blurriness and ghosting.

Abstract: An interactive display, including a cover glass having a front surface that includes a viewing area provides an input/output (I/O) interface for a user of an electronic device. An arrangement includes a processor, a light source, and a camera disposed outside the periphery of the viewing area coplanar with or behind the cover glass. The camera receives scattered light resulting from interaction, with an object, of light outputted from the interactive display, the outputted light being received by the cover glass from the object and directed toward the camera. The processor determines, from image data output by the camera, an azimuthal angle of the object with respect to an optical axis of the camera and/or a distance of the object from the camera.

Abstract: Described are systems and methods for measuring objects using stereoscopic imaging. After determining keypoints within a set of stereoscopic images, a user may select a desired object within an imaged scene to be measured. Using depth map information and information about the boundary of the selected object, the desired measurement may be calculated and displayed to the user on a display device. Tracking of the object in three dimensions and continuous updating of the measurement of a selected object may also be performed as the object or the imaging device is moved.

Abstract: A method operational on a transmitter device is provided for projecting a composite code mask. A composite code mask on a tangible medium is obtained, where the composite code mask includes a code layer combined with a carrier layer. The code layer may include uniquely identifiable spatially-coded codewords defined by a plurality of symbols. The carrier layer may be independently ascertainable and distinct from the code layer and includes a plurality of reference objects that are robust to distortion upon projection. At least one of the code layer and carrier layer may be pre-shaped by a synthetic point spread function prior to projection. At least a portion of the composite code mask is projected, by the transmitter device, onto a target object to help a receiver ascertain depth information for the target object with a single projection of the composite code mask.

Abstract: A method operational on a receiver device for decoding a codeword is provided. At least a portion of a composite code mask is obtained, via a receiver sensor, and projected on the surface of a target object. The composite code mask may be defined by a code layer and a carrier layer. A code layer of uniquely identifiable spatially-coded codewords may be defined by a plurality of symbols. A carrier layer may be independently ascertainable and distinct from the code layer and may include a plurality of reference objects that are robust to distortion upon projection. At least one of the code layer and carrier layer may have been pre-shaped by a synthetic point spread function prior to projection. The code layer may be adjusted, at a processing circuit, for distortion based on the reference objects within the portion of the composite code mask.

Abstract: A method for generating codes for a code mask is provided. A plurality of symbols may be arranged into an n1 by n2 symbol structure, where n1 and n2 are integer values. A plurality of codewords may be defined from different overlapping k1 by k2 windows within the symbol structure, wherein co-linear and spatially overlapping windows define unique codewords, and the codewords are unique in a first direction of the symbol structure but are repeated in a second direction that is perpendicular to the first direction. A plurality of the symbol structures as a code mask, wherein symbols in two adjacent k1 by k2 windows are selected so as to avoid codeword aliasing of codewords in the two adjacent k1 by k2 windows.