Abstract: A method, system, and one or more computer-readable storage media for depth acquisition from density modulated binary patterns are provided herein. The method includes capturing a number of images for a scene using an IR camera and a number of IR lasers including diffraction grates. Each image includes a density modulated binary pattern carrying phase information. The method also includes performing pixel based phase matching for the images to determine depth data for the scene based on the phase information carried by the density modulated binary patterns.

Abstract: Conventionally, on a subject in which range, refocus can be performed at the time of image capturing or at the time of editing an image is not specified clearly, and therefore, it is difficult for a user to capture an image or to edit an image in a manner the user intends. An image processing apparatus has an acquisition unit configured to acquire an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas and a generation unit configured to generate a shifted image in which positions of the plurality of subject areas are shifted in the image based on the distance information.

Abstract: An image acquisition unit 52 acquires images consecutively captured while an image capture range is moved in a predetermined direction. A face detection unit 53 detects same subject images from the images acquired. A facial expression determination unit 55 calculates evaluation values of each of the same subject images detected. A facial expression decision unit 56 decides, as a combination target, a specific subject image from the same subject images, based on the evaluation values calculated. A combination unit 58 generates a wide-range image by combining the subject image decided as the combination target with the images sequentially acquired by the image acquisition unit 52.

Abstract: The present invention relates to a blind spot warning system and method for sensing a vehicle in a blind spot of a vehicle and warning thereof in advance, the blind spot warning system comprising a line-to-line space-generating unit that generates, in real time, line-to-line space data, which changes when the host vehicle is driven; a distance-measuring unit, which measures the distance between the host vehicle and a target vehicle located in a blind spot of the host vehicle; an input unit, which receives the line-to-line space data and the distance measurement information; a comparison unit, which compares the target vehicle distance data with the line-to-line space data to decide whether the target vehicle is located within the threshold vehicle-to-vehicle distance; and a warning output unit for outputting a warning if the target vehicle is located within the threshold vehicle-to-vehicle distance in the blind spot.

Abstract: A depth measurement apparatus calculates depth information on a subject in an image by using a plurality of images having different blurs taken under different imaging parameters, and includes a region segmentation unit that segments at least one of the images into regions based on an image feature amount, wherein in each of the regions pixels are presumed to be substantially equal in depth to the subject, and a depth calculation unit that calculates a depth for each region resulting from the segmentation by the region segmentation unit and serving as a processing target region for depth calculation, and sets the calculated depth as the depth of the processing target region.

Abstract: Technologies are generally described for projecting structured light patterns onto an Augmented Reality (AR) scene in order to track AR camera motion in AR systems. In some examples, structured light patterns may be projected onto the AR scene from a light source in the same plane as the AR camera in order to preserve a consistent reference point for detecting the structured light pattern. The AR camera may detect the structured light patterns and determine the location of the AR camera based on a distance analysis of the detected structured light patterns. Based on the changing locations of the AR camera, the system may track the movement of the AR camera as its location relative to the AR scene changes.

Abstract: A disparity calculating method includes generating an energy matrix according to a first image-block and a second image-block, wherein the energy matrix includes a plurality of energies of a plurality of pixels corresponding to a plurality of disparity candidates; setting the energy corresponding to a starting pixel of the plurality of pixels and a specified disparity candidate of the plurality of disparity candidates as a first predetermined value and setting the energies corresponding to the starting pixel and other disparity candidates of the plurality of disparity candidates as a second predetermined value, wherein the second predetermined value is greater than the first predetermined value; generating a path matrix according to the energy matrix; and determining a plurality of disparities of the plurality of pixels sequentially from an ending pixels of the plurality of pixels, wherein the disparity of the ending pixel is set as a third predetermined value.

Abstract: According to an illustrative embodiment, a method for detecting a document includes capturing a first plurality of images of a document at a first wavelength of electromagnetic radiation, capturing a second plurality of images of the document at a second wavelength of electromagnetic radiation, and assembling the first and second pluralities of images to form one or more images of the document.

Abstract: The present specification relates to an apparatus for detecting a medium image. According to one aspect, the apparatus for detecting the medium image comprises: a light emitting unit to emit the light toward the medium to be transferred along a transferring path; an image sensor having a light receiving unit to receive the light emitted from the light emitting unit; a reference medium which is arranged at a position separated from the transferring path and enables the image sensor to obtain an image; and a control unit to compensate the image of the medium obtained from the image sensor using the image of the reference medium obtained from the image sensor.

Abstract: Provided is an image processing apparatus and method for adjusting a color image using a depth image. The image processing apparatus may include a color image segmenting unit to segment a color image into a plurality of color segments, using a color layer of the color image, a depth image segmenting unit to segment a depth image into a plurality of depth segments, using a depth layer of the depth image, and a layer boundary adjusting unit to adjust a boundary value of the color layer, using the plurality of color segments and the plurality of depth segments.

Abstract: When estimating distance to an object in an image using a single camera, data acquired by an onboard accelerometer is analyzed to determine camera speed as the user takes a video of the object of interest. The compression that results during video processing is used to derive motion vectors for the object of interest in the scene. The motion vectors have an opposite direction to the camera motion and a magnitude that is a function of the unknown object distance and a known magnification level. The object distance is calculated from the estimated velocity and motion vector magnitude.

Abstract: The method of the invention comprises: obtaining a sequence of at least two images, with different levels of illumination; extracting the region containing the sign in the image; calculating the luminance values of the signs; and obtaining the difference in luminance of the sign corresponding to the two levels of illumination. The value obtained is the luminance of the sign (11) corresponding to an illumination equal to the difference between the illuminations, or additional illumination. This result is based on the additive property of luminance, according to which the luminance of a sign is the sum of the luminance produced by each source of illumination. A basic illumination device (5), an additional illumination device (7), at least one camera for taking images, and image recording, positioning and synchronism systems are required to implement the method.

Abstract: A two-dimensional pattern comprises a plurality of R-planes each comprising a tiling of a corresponding R-ary block, being a block of radix R integer values, where for each dimension of the pattern, the least common multiple of the sizes of the tiled blocks in that dimension is greater than the size of the tiling that dimension, and any sub-block of a size less than the tiled blocks occurs on a regular grid with the same periodicity as the tiled block for that R-plane. The pattern may be used in determining a position of a location captured in an image by projecting the pattern onto a scene. An image is captured. The method determines from the captured image a sub-block associated with the location and constructs, a unique integer value for each R-plane. The unique integer values from each R-plane are used to determine the location in the image.

Abstract: A method and apparatus for Time Of Flight sensor 2-dimensional and 3-dimensional map generation. The method includes retrieving Time Of Flight sensor fixed point data to obtain four phases of Time Of Flight fixed point raw data, computing Gray scale image array and phase differential signal arrays utilizing four phases of TOF fixed point raw data, computing Gray image array and Amplitude image array for fixed point, converting the phase differential signal array from fixed point to floating point, performing the floating point division for computing Arctan, TOF depthmap, and 3-dimensional point cloud map for Q format fixed point, and generating depthmap, 3-dimensional cloud coefficients and 3-dimensional point cloud for Q format fixed point.

Abstract: A conversion method and apparatus with a generating of a depth map for two dimensional (2D)-to-three dimensional (3D) conversion. A depth order may be restored based on a line tracing and an edge map generated from an input image, and a stereo image may be generated using depth information.

Abstract: A pedestrian detection system of detecting whether there is a pedestrian in a scene, the pedestrian detection system includes an image-capturing module, a preprocessing module, a human detection module, an image-stitching module and a decision module. The image-capturing module is configured for generating a plurality of first detection image data according to a contrast decision result. The preprocessing module is configured for generating a plurality of first image skeleton data according to the first detection image data. The human detection module is configured for generating a plurality of second image skeleton data. The image-stitching module is configured for stitching the plurality of first detection image data to generate at least one third detection image data. The decision module is configured for generating and outputting a detection result according to the third detection image data. A pedestrian detection method is disclosed herein as well.

Abstract: According to one embodiment, an image processing device includes an obtaining unit, a separating unit, a processing unit and a combining unit. The obtaining unit obtains a depth value of a subject imaged on an input image. The separating unit separates the input image into a first component that is a component including a gradation and a second component that is a component other than the first component. The processing unit enhances the first component in accordance with the depth value to generate a processed component. The combining unit combines the processed component and the second component to generate a combined component.

Abstract: An image sensor includes a unit pixel including a plurality of color pixels with a depth pixel. A first signal line group of first signal lines is used to supply first control signals that control operation of the plurality of color pixels, and a separate second signal line group of second signal lines is used to supply second control signals that control operation of the depth pixel.

Abstract: Pixel-based and region-based methods, computer program products, and systems for detecting, flagging, highlighting on a display, and automatically fixing edge violations in stereoscopic images and video. The highlighting and display methods involve signed, clamped subtraction of one image of a stereo image pair from the other image, with the subtraction preferably isolated to a region of interest near the lateral edges. Various embodiments include limiting the detection, flagging, and highlighting of edge violations to objects causing a degree of perceptual discomfort greater than a user-set or preset threshold, or to objects having a certain size and/or proximity and/or degree of cut-off by a lateral edge of the left or right eye images of a stereo image pair. Methods of removing violations include automatic or semi-automatic cropping of the offending object, and depth shifting of the offending object onto the screen plane.

Abstract: A vision based pedestrian and cyclist detection method includes receiving an input image, calculating a pixel value difference between each pixel and the neighbor pixels thereof, quantifying the pixel value difference as a weight of pixel, proceeding statistics for the pixel value differences and the weights, determining intersections of the statistics as a feature of the input image, classifying the feature into human feature and non-human feature, confirming the human feature belonging to cyclist according to the spatial relationship between the human feature and the detected two-wheeled vehicle, and retaining one detection result for each cyclist by suppressing other weaker spatial relationships between the human feature and the detected two-wheeled vehicle.

Abstract: The present application discloses systems and methods for a virtual input device. In one example, the virtual input device includes a projector and a camera. The projector projects a pattern onto a surface. The camera captures images that can be interpreted by a processor to determine actions. The projector may be mounted on an arm of a pair of eyeglasses and the camera may be mounted on an opposite arm of the eyeglasses. A pattern for a virtual input device can be projected onto a “display hand” of a user, and the camera may be able to detect when the user uses an opposite hand to select items of the virtual input device. In another example, the camera may detect when the display hand is moving and interpret display hand movements as inputs to the virtual input device, and/or realign the projection onto the moving display hand.

Abstract: An autonomous mobile system for a mobile body which moves while localizing itself in a space includes a shape detector and travel distance detector for measuring whether objects are present in set regions determined by dividing a three-dimensional space into a plurality of segments, a storage device into which map data is stored that indicates a region of the set regions that has been set as having a stationary object in the region, a determining section that determines, from frequency of the object detection by the shape detector during a predetermined time for each of the set regions, whether the object that has been detected in each set region is a stationary object or a moving object, and a localizer that localizes a vehicle by matching the region that the determining section has determined to have a stationary object in the region, and the map data.

Abstract: A risk potential estimating device 20 of a driving support apparatus 10 calculates the risk potential of an object at each of a plurality of points which are set around a host vehicle 100. When there is a pedestrian M2 in a blind spot B caused by a pedestrian M1 in the field of view of the host vehicle 100, the risk potential estimating device 20 omits the calculation of the risk potential of the pedestrian M2. When there is the pedestrian M1 close to the host vehicle 100, first, the behavior of avoiding the pedestrian M1 is performed. Therefore, the risk potential of the pedestrian M1 may be calculated at each point. In many cases, the calculation of the risk potential of the pedestrian M2 which is located in the blind spot B caused by the pedestrian M1 and is away from the host vehicle 100 is redundant.

Abstract: A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Abstract: A method for operating illumination sources includes receiving a first set of images of one or more illumination sources that are generated by an image capturing device. The method further includes computing a first distance and a first perspective angle between the image capturing device and each illumination source during the generation of the first set of images. Furthermore, the method includes generating first characteristic information for each illumination source based on a comparison between at least one of the first distance or the first perspective angle for each illumination source with at least one of a predefined distance or a predefined perspective angle for each illumination source. The method also includes generating a command signal based on a comparison between the first characteristic information and a predefined characteristic threshold for each of the one or more illumination sources.

Abstract: A method, computer readable storage device, and apparatus for determining the distance a computing device is located from a user's face. An image of an individual is obtained. A first pupil location and a second pupil location are identified based on the obtained image. A first distance between the identified first and second pupil location is determined. A second distance between the individual and the computing device is determined based on the determined first distance between the identified first and second pupil locations.

Abstract: Systems and methods for determining an inventory condition of objects based on captured images are described. An exemplary inventory control system or method utilizes a highly efficient and economical approach to apply suitable imaging parameters for capturing images of a storage drawer being accessed by a user, or for manipulating the captured images of the drawer. An inventory condition of the drawer is determined based on the captured images or manipulated images.

Abstract: A method comprising: obtaining an image about an at least one object of interest and a three-dimensional (3D) point cloud about said object of interest; aligning the 3D point cloud with the image; segmenting the image into a plurality of superpixels preserving a graph structure and spatial neighbourhood of pixel data of the image; associating the superpixels in the image with a subset of said 3D points, said subset of 3D points representing a planar patch in said object of interest; extracting a plurality of 3D features for each patch; and assigning at least one vector representing at least one 3D feature with a semantic label on the basis of at least one extracted 3D feature of the patch.

Abstract: An image classification program that is executed by a computer includes a first processing step of calculating feature values on the basis of the pixel densities of images, a second processing step of performing calculating in a space defined by the feature values, and a third processing step of grouping images that correspond to feature values that have been divided by the clustering.

Abstract: A curtain coating method including forming a curtain including a coating material. A coated web is formed by coating a moving primary web with the coating material. The curtain and the primary web meet at a contact line. A primary pattern is projected on a material layer. The material layer moves with respect to the contact line. The primary pattern includes a first pointer feature. A first image is captured. The first image includes a first sub-image of the first pointer feature. The position of the first sub-image is in the first image is detected. Distance information is provided by comparing the detected position of the first sub-image with a reference position.

Abstract: An apparatus for measuring feet, for the purpose of gathering measurements for custom shoes, is disclosed. The apparatus is shaped like a shoe, and has an opening where the shoe lace opening is normally present on the shoe, in addition to openings near the big toe and the little toe. Each opening has holes for laces that are tightened so that the gap, or overlap, of the openings can be measured. Additionally, mats of known thickness can be used to measure the distance between the heel of the shoe and the heel of the foot. Furthermore, markings are used to identify the different shoe lace holes so measurements can be taken at multiple places along the top of the foot. Furthermore, a size indicator can be shown on the shoe, so that measurements can be taken on a picture of the foot in the shoe rather than on the foot and shoe themselves, and then scaled to actual size with reference to the size indicator.

Abstract: Disclosed is an approach for delivering visual content that improves network bandwidth utilizations. The visual data is separated into multiple categories, where the data for different categories are delivered using different bandwidth utilizations schemes. A first category of the data is delivered at a higher frame rate than the frame rate for a second category of the data.

Abstract: Determining GPS coordinates of some image point(s) positions in at least two images using a processor configured by program instructions. Receiving position information of some of the positions where an image capture device captured an image. Determining geometry by triangulating various registration objects in the images. Determining GPS coordinates of the image point(s) positions in at least one of the images. Saving GPS coordinates to memory. This system and method may be used to determine GPS coordinates of objects in an image.

Abstract: An information processing system that acquires image data corresponding to a target object that is a target for gesture recognition captured by an imaging device; determines whether a distance between the target object and the imaging device is inadequate for recognition of a gesture made by the target object; and outputs a notification when the determining determines that the distance between the target object and the imaging device is inadequate for recognition of a gesture made by the target object.

Abstract: A three-dimensional measurement apparatus includes a model holding unit configured to hold a three-dimensional shape model of a measurement object and a determination unit configured to determine a distance measurement region on the measurement object based on information indicating a three-dimensional shape of the measurement object. The measurement object is irradiated with a predetermined illumination pattern by an illumination unit. An image of the measurement object is sensed while the illumination unit irradiates the measurement object. Distance information indicating a distance from the image sensing unit to the measurement object is calculated based on region corresponding to the distance measurement region within the sensed image. A position and orientation of the measurement object is calculated based on the distance information and the three-dimensional shape model.

Abstract: An operation method of an image sensor includes determining a distance between the image sensor and an object, and activating at least one of a color pixel, a depth pixel and a thermal pixel included in a pixel array of the image sensor based on a determined distance and a reference distance.

Abstract: The disclosure is directed to creating an inertial sensor aided depth map of a scene. An embodiment of the disclosure captures at least a first image and a second image during movement of a device caused by a user while framing or recording the scene, compensates for rotation between the first image and the second image, calculates an amount of translation of the device between the first image and the second image, calculates a pixel shift of a plurality of key points of the first image and the second image, and estimates a depth to one or more of the plurality of key points of the first image and the second image.

Abstract: An apparatus includes an acquisition unit configured to acquire an input image, an identifying unit configured to identify a distance from a reference point to a processing target pixel in the input image, a deformation unit configured to deform an image based on the distance, and a sharpening processing unit configured to perform sharpening processing on an image while changing a strength of the sharpening processing, the changing of the strength based on the distance.

Abstract: An image processing device capable of generating foreground object data by using a captured image includes a depth data generator configured to generate depth data of the captured image; an amplitude data generator configured to generate amplitude data of the captured image; a foreground object detector configured to perform a first detection operation for detecting the foreground object based on the generated depth data and first reference background data, and to perform a second detection operation for detecting the foreground object based on the generated amplitude data and second reference background data; and a foreground object data generator configured to generate the foreground object data based on a result of the first detection operation and a result of the second detection operation.

Abstract: A method and a system for measuring a distance from a reference point to an object are provided. The method comprises the following steps. At least one image of an object is captured through a lens comprising a phase mask composed of a parallel plate and a wedge prism. At least two corresponding regions of interest (ROI) are obtained from the images. The regions of interest correspond to identical portions of the object. The relative coordinates between corresponding locations within the corresponding regions of interest is measured. The distance is calculated according to the relative coordinates.

Abstract: At least some of the exemplary embodiments are a method. The method includes obtaining, at an underwater imaging device, a stream of images of geophysical surveying equipment, wherein the geophysical surveying equipment includes a target pattern having a calibrated image size. The geophysical surveying equipment is tracked using the image stream and the target pattern. The method further includes capturing from the image stream, a single image of the images of the geophysical surveying equipment, wherein the single image comprises an image of the target pattern having an apparent size. Based on the calibrated image size and the apparent size, a distance between the underwater imaging device and the geophysical surveying equipment is determined.

Abstract: A method of simultaneous localization and mapping includes initializing a robot pose and a particle model of a particle filter. The particle model includes particles, each having an associated map, robot pose, and weight. The method includes receiving sparse sensor data from a sensor system of the robot, synchronizing the received sensor data with a change in robot pose, accumulating the synchronized sensor data over time, and determining a robot localization quality. When the accumulated sensor data exceeds a threshold accumulation and the robot localization quality is greater than a threshold localization quality, the method includes updating particles with accumulated synchronized sensor data. The method includes determining a weight for each updated particle of the particle model and setting a robot pose belief to the robot pose of the particle having the highest weight when a mean weight of the particles is greater than a threshold particle weight.

Abstract: A drive assist device includes a light source that irradiates a detection target with light, a first lens having a first area through which the irradiated light from the light source passes, a second lens having a second area through which reflected light reflected from the detection target passes, and a light receiving element that receives the reflected light that passes the second lens. The first area and the second area are arranged to be in align with each other, in width direction of the drive assist device.

Abstract: Certain embodiments enable image-based stimulus for circuit simulations by extracting a waveform from an image and using that waveform to simulate a circuit. Image-processing aspects may include edge-detection processes to identify a boundary of the waveform in the image.

Abstract: A method for determining a position using digital pixel data includes receiving pixel data from a position sensor device at a controller, sorting the received pixel data into pixel banks using the controller, identifying a maximum bank, a close bank, and a far bank using the controller, calculating a close to max ratio using a first equation and a max to far ratio using a second equation using the controller, and determining a position based on said close to max ratio and said far to max ratio.

Abstract: A vehicular imaging system comprises a single imaging sensor having a plurality of photosensor elements. The imaging sensor captures image data of a scene exterior of the vehicle within its field of view. Image data captured by the imaging sensor is provided to a control. The control also receives via a communication bus at least one of vehicle pitch information, vehicle yaw information and vehicle steering information. The control detects two substantially straight and converging road features along the road the vehicle is travelling and determines a point of intersection where they would converge using, at least in part, the received vehicle information and the control automatically corrects for misalignment of the imaging sensor mounted at the vehicle.

Abstract: An autonomous vehicle configured to determine the heading of an object-of-interest based on a point cloud. An example computer-implemented method involves: (a) receiving spatial-point data indicating a set of spatial points, each spatial point representing a point in three dimensions, where the set of spatial points corresponds to an object-of-interest; (b) determining, for each spatial point, an associated projected point, each projected point representing a point in two dimensions; (c) determining a set of line segments based on the determined projected points, where each respective line segment connects at least two determined projected points; (d) determining an orientation of at least one determined line segment from the set of line segments; and (e) determining a heading of the object-of-interest based on at least the determined orientation.

Abstract: A measurement apparatus includes a projection unit configured to project pattern light onto an object to be measured, an imaging unit configured to capture an image of the object to be measured on which the pattern light is projected to acquire a captured image of the object to be measured, a measurement unit configured to measure a position and/or orientation of the object to be measured on the basis of the captured image, a position and orientation of the projection unit, and a position and orientation of the imaging unit, a setting unit configured to set identification resolution of the pattern light using a range of variation in the position and/or orientation of the object to be measured; and a change unit configured to change a pattern shape of the pattern light in accordance with the identification resolution.

Abstract: There is provided an image processing apparatus including a distance information generation portion configured to generate first distance information about an object to be measured based on a phase difference between images provided by a plurality of first cameras having a first base length, and generate second distance information about the object to be measured based on a phase difference between images provided by a plurality of second cameras having a second base length that is different from the first base length; and a distance extraction portion configured to extract distance information from an imaging position and the object to be measured based on the first distance information and the second distance information.

Abstract: Aspects of depth map generation and post capture focusing and re-focusing are described. According to one embodiment, a depth map is generated. The depth map may include a mapping among relative depth values in a field of view of an image based on a difference between pixels of a first image and pixels of a second image. An edge map may also be generated by identifying edges in at least one of the first image or the second image. Using the depth map and the edge map, the relative depth values in the depth map may be smoothed using the edge map. In this manner, certain discontinuities in depth values may be smoothed within edge-bounded regions defined by the edge map. The depth map may be used for focusing and re-focusing, for example, or for object extraction, scene understanding, or gesture recognition, among other imaging processes.