Abstract: A method for depth measurement with a time-of-flight camera using amplitude-modulated continuous light by acquiring for each of a plurality of pixels of a sensor array of the camera at least one sample sequence having at least four amplitude samples (A0, A1, A2, A3) at a sampling frequency higher than a modulation frequency of the amplitude-modulated continuous light. The method further includes: determining for each sample sequence of each pixel a confidence value (C) indicating a degree of correspondence of the amplitude samples (A0, A1, A2, A3) with a sinusoidal time evolution of the amplitude; and determining for each of a plurality of binning areas, each of which comprises a plurality of pixels, a binned depth value (Db) based on the amplitude samples (A0, A1, A2, A3) of sample sequence of pixels from the binning area, wherein the contribution of a sample sequence to the binned depth value (Db) depends on its confidence value (C).

Abstract: A method for corrected depth measurement with a time-of-flight camera using amplitude-modulated continuous light. In order to enable an accurate and efficient depth measurement with a time-of-flight camera, the method includes, for each of a plurality of pixels of a sensor array of the camera: acquiring with the camera a raw depth value rm for the pixel; and automatically calculating a ground truth value rt according to: rt=g(rm?cm)+ct, to correct a systematic depth error of the raw depth value rm, wherein cm is a pixel-dependent first offset, g is a pixel-independent first function and ct is a pixel-independent second offset.

Abstract: A method and system for real-time motion artifact handling and noise removal for time-of-flight (ToF) sensor images. The method includes: calculating values of a cross correlation function c(?) at a plurality of temporally spaced positions or phases from sent (s(t)) and received (r(t)) signals, thereby deriving a plurality of respective cross correlation values [c(?0), c(?1), c(?2), c(?3)]; deriving, from the plurality of cross correlation values [c(?0), c(?1), c(?2), c(?3)], a depth map D having values representing, for each pixel, distance to a portion of an object upon which the sent signals (s(t)) are incident; deriving, from the plurality of cross correlation values [c(?0), c(?1), c(?2), c(?3)], a guidance image (I; I?); and generating an output image D? based on the depth map D and the guidance image (I; I?), the output image D? comprising an edge-preserving and smoothed version of depth map D, the edge-preserving being from guidance image (I; I?).

Abstract: A method for corrected depth measurement with a time-of-flight camera using amplitude-modulated continuous light. In order to enable an accurate and efficient depth measurement with a time-of-flight camera, the method includes, for each of a plurality of pixels of a sensor array of the camera: acquiring with the camera a raw depth value rm for the pixel; and automatically calculating a ground truth value rt according to: rt=g(rm?cm)+ct, to correct a systematic depth error of the raw depth value rm, wherein cm is a pixel-dependent first offset, g is a pixel-independent first function and ct is a pixel-independent second offset.

Abstract: A method for head pose estimation using a monocular camera. The method includes: providing an initial image frame recorded by the camera showing a head; and performing at least one pose updating loop with the following steps: identifying and selecting of a plurality of salient points of the head having 2D coordinates in the initial image frame within a region of interest; determining 3D coordinates for the selected salient points using a geometric head model of the head, corresponding to a head pose; providing an updated image frame recorded by the camera showing the head; identifying within the updated image frame at least some previously selected salient points having updated 2D coordinates; updating the head pose by determining updated 3D coordinates corresponding to the updated 2D coordinates using a perspective-n-point method; and using the updated image frame as the initial image frame for the next pose updating loop.

Abstract: A camera system comprises a 3D TOF camera for acquiring a camera-perspective range image of a scene and an image processor for processing the range image. The image processor contains a position and orientation calibration routine implemented therein in hardware and/or software, which position and orientation calibration routine, when executed by the image processor, detects one or more planes within a range image acquired by the 3D TOF camera, selects a reference plane among the at least one or more planes detected and computes position and orientation parameters of the 3D TOF camera with respect to the reference plane, such as, e.g., elevation above the reference plane and/or camera roll angle and/or camera pitch angle.

Abstract: A method for determining a distance comprises: providing at least two phase measurements made with modulated light of different modulation wavelengths, each phase measurement being indicative of the distance up to an integer multiple of a respective modulation wavelength; providing a set of possible wraparound count combinations; for each one of the possible wraparound count combinations, calculating a combination of unwrapped phase hypotheses corresponding to the at least two phase measurements; and selecting a most plausible combination of unwrapped phase hypotheses among the combinations of unwrapped phase hypotheses and calculating the distance based upon the selected most plausible combination of unwrapped phase hypotheses.

Abstract: A method and system for real-time noise removal and image enhancement of high-dynamic range (HDR) images. The method includes receiving an HDR input image I and operating processing circuitry for (i) applying a first edge-preserving filter (e.g. guided filter) to the input image I, thereby generating a first image component B1 and a first set of linear coefficients ?i,1; (ii) applying a second edge-preserving filter (e.g. guided filter) to the input image I, thereby generating a second image component B2 and a second set of linear coefficients ?i,2; (iii) generating a plausibility mask P from a combination of the first set of linear coefficients ?i,1 and the second set of linear coefficients ?i,2, the plausibility mask P indicating spatial detail within the input image I; and (iv) generating an output image O based on first image component B1, the second image component B2 and the plausibility mask P.

Abstract: A method for enhancing a depth image of a scene, comprises calculating an enhanced depth image by blending a first filtered depth image with a second filtered depth image or with the original depth image. The blending is achieved by application of a blending map, which defines, for each pixel, a contribution to the enhanced depth image of the corresponding pixel of the first filtered depth image and of the corresponding pixel of either the second filtered depth image or the original depth image. For pixels in the depth image containing no depth value or an invalid depth value, the blending map defines a zero contribution of the corresponding pixel of the second filtered depth image and a 100% contribution of the corresponding pixel of the first filtered image.

Abstract: A method and system for real-time motion artifact handling and noise removal for time-of-flight (ToF) sensor images. The method includes: calculating values of a cross correlation function c(?) at a plurality of temporally spaced positions or phases from sent (s(t)) and received (r(t)) signals, thereby deriving a plurality of respective cross correlation values [c(?0), c(?1), c(?2), c(?3)]; deriving, from the plurality of cross correlation values [c(?0), c(?1), c(?2), c(?3)], a depth map D having values representing, for each pixel, distance to a portion of an object upon which the sent signals (s(t)) are incident; deriving, from the plurality of cross correlation values [c(?0), c(?2), c(?3)], a guidance image (I; I?); and generating an output image D? based on the depth map D and the guidance image (I; I?), the output image D? comprising an edge-preserving and smoothed version of depth map D, the edge-preserving being from guidance image (I; I?).

Abstract: A method and system for real-time noise removal and image enhancement of high-dynamic range (HDR) images. The method includes receiving an HDR input image I and operating processing circuitry for (i) applying a first edge-preserving filter (e.g. guided filter) to the input image I, thereby generating a first image component B1 and a first set of linear coefficients ?i,1; (ii) applying a second edge-preserving filter (e.g. guided filter) to the input image I, thereby generating a second image component B2 and a second set of linear coefficients ?i,2; (iii) generating a plausibility mask P from a combination of the first set of linear coefficients ?i,1 and the second set of linear coefficients ?i,2, the plausibility mask P indicating spatial detail within the input image I; and (iv) generating an output image O based on first image component B1, the second image component B2 and the plausibility mask P.

Abstract: A dynamic reference range image generation method comprises providing a reference range image, to be dynamically updated, composed of pixels, each of which contains a reference range value. An acquired range image is provided, the pixels of which contain each a measured range value, the measured range values being updated at a predetermined rate. Pixels of the acquired range image containing an invalid measured range value are accordingly marked. The measured range value of each pixel of the acquired range image not marked as containing an invalid measured range value is compared with the reference range value of the corresponding pixel of the reference range image. The reference range value of that pixel of the reference range image is updated e.g.

Abstract: A method for determining a distance comprises: providing at least two phase measurements made with modulated light of different modulation wavelengths, each phase measurement being indicative of the distance up to an integer multiple of a respective modulation wavelength; providing a set of possible wraparound count combinations; for each one of the possible wraparound count combinations, calculating a combination of unwrapped phase hypotheses corresponding to the at least two phase measurements; and selecting a most plausible combination of unwrapped phase hypotheses among the combinations of unwrapped phase hypotheses and calculating the distance based upon the selected most plausible combination of unwrapped phase hypotheses.

Abstract: One or more imaging device(s) inside a car that look(s) at occupants (driver, front passenger, rear passengers) and cover(s) multiple security, comfort, driver assistance and occupant state related functions, wherein the imaging device includes an illumination in the near infrared. An imaging device inside the car that can measure occupants' vital signs (heart rate, respiration rate, blood oxygen saturation) using contactless imaging photoplethysmography.

Abstract: A method for enhancing a depth image of a scene, comprises calculating an enhanced depth image by blending a first filtered depth image with a second filtered depth image or with the original depth image. The blending is achieved by application of a blending map, which defines, for each pixel, a contribution to the enhanced depth image of the corresponding pixel of the first filtered depth image and of the corresponding pixel of either the second filtered depth image or the original depth image. For pixels in the depth image containing no depth value or an invalid depth value, the blending map defines a zero contribution of the corresponding pixel of the second filtered depth image and a 100% contribution of the corresponding pixel of the first filtered image.

Abstract: A method for contamination detection in a time-of-flight (TOF) range imaging system is described, wherein the TOF range imaging system receives light reflected from a scene, through an optical interface, on an imager sensor having an array of pixels, and wherein distance information and amplitude information are determined for the sensor pixels. The presence of contamination on the optical interface is determined on the basis of amplitude information determined for the sensor pixels.

Abstract: A method for matching the pixels (10-1, 10-2) of a first range image of a scene (18) as seen from a first point of sight (14) with pixels (12-1, 12-2) of a second range image of the scene as seen from a second point of sight (16) comprises the following steps: providing the first range image as a grid of source pixels (10), on which the scene is mapped in accordance with a first projection associated with the first point of sight, wherein each source pixel has a point in the scene projected thereon in accordance with the first projection and has associated therewith a range value determined for that point in the scene; providing a grid of target pixels (12) for the second range image and a second projection associated with the second point of sight; and for each one of the target pixels, a) determining which source pixel would have the same point (P1, P2) in the scene projected thereon in accordance with the first projection as the target pixel would have projected thereon in accordance with the second projec

Abstract: A method of recording 3D images of a scene based on the time-of-flight principle is described. The method includes illuminating a scene by emitting light carrying an intensity modulation, imaging the scene onto a pixel array using an optical system, detecting, in each pixel, intensity-modulated light reflected from the scene onto the pixel and determining, for each pixel, a distance value based on the phase of light detected in the pixel. The determination of the distance values includes a phase-sensitive de-convolution of the scene imaged onto the pixel array such that phase errors induced by light spreading in the optical system are compensated for.

Abstract: A method for matching the pixels (10-1, 10-2) of a first range image of a scene (18) as seen from a first point of sight (14) with pixels (12-1, 12-2) of a second range image of the scene as seen from a second point of sight (16) comprises the following steps: providing the first range image as a grid of source pixels (10), on which the scene is mapped in accordance with a first projection associated with the first point of sight, wherein each source pixel has a point in the scene projected thereon in accordance with the first projection and has associated therewith a range value determined for that point in the scene; providing a grid of target pixels (12) for the second range image and a second projection associated with the second point of sight; and for each one of the target pixels, a) determining which source pixel would have the same point (P1, P2) in the scene projected thereon in accordance with the first projection as the target pixel would have projected thereon in accordance with the second projec

Abstract: Method for determining the position of an object point in a scene from a digital image thereof acquired through an optical system is presented. The image comprises a set of image points corresponding to object points and the position of the object points are determined by means of predetermined vectors associated with the image points. The predetermined vector represents the inverted direction of a light ray in the object space that will produce this image point through the optical system comprising all distortion effects of the optical system.