Abstract: A method for forming a three-dimensional (3D) map of an object, including illuminating the object from a light source so as to project a pattern onto the object, capturing an image of the pattern using an array of detector elements, and processing the captured image so as to measure respective offsets of elements of the pattern in the captured image relative to a reference pattern, the offsets including at least a first offset of a first element of the pattern and a second offset of a second element of the pattern, measured respectively in first and second, mutually-perpendicular directions in a plane of the array. The method further includes computing a correction factor in response to the first offset, applying the correction factor to the second offset so as to find a corrected offset, and computing depth coordinates of the object in response to the corrected offset.
Type:
Grant
Filed:
July 5, 2012
Date of Patent:
May 3, 2016
Assignee:
APPLE INC.
Inventors:
Daniel Cohen, Dmitri Rais, Erez Sali, Niv Galezer, Alexander Shpunt
Abstract: A solid-state image sensor includes a semiconductor layer, a multilayer wiring layer, an opening which extends through the semiconductor layer, and reaches an electrically conductive layer in the multilayer wiring layer, an electrically conductive member arranged in the opening so as to be connected to the electrically conductive layer, and a trench which surrounds the opening, and extends through the semiconductor layer, the trench having a space with no solid substance, and the semiconductor layer including a wall portion arranged between a side face defining the opening, and an inner-side face defining the trench to surround the electrically conductive member.
Abstract: In a case of a camera array, the arrangement of image capturing units and the arrangement of captured images that are displayed do not agree with each other depending on the orientation of the camera at the time of image capturing and it is hard to grasp the correspondence relationship between both. An image processing device for processing a plurality of images represented by captured image data obtained by a camera array image capturing device including a plurality of image capturing units includes a determining unit configured to determine, on the basis of a display angle of the images in a display region, an arrangement of each image in the display region corresponding to each of the plurality of image capturing units, and the arrangement of each image in the display region is determined based on the arrangement of the plurality of image capturing units.
Abstract: An apparatus, method, and computer-readable medium for motion sensor-based video stabilization. A motion sensor may capture motion data of a video sequence. A controller may compute instantaneous motion of the camera for a current frame of the video sequence and accumulated motion of the camera corresponding to motion of a plurality of frames of the video sequence. The controller may compare the instantaneous motion to a first threshold value, compare the accumulated motion to a second threshold value, and set a video stabilization strength parameter for the current frame based on the results of the comparison. A video stabilization unit may perform video stabilization on the current frame according to the frame's strength parameter.
Type:
Grant
Filed:
June 8, 2012
Date of Patent:
March 29, 2016
Assignee:
Apple Inc.
Inventors:
Jianping Zhou, Sebastien X. Beysserie, George E. Williams, Rolf Toft
Abstract: A system and method for correcting the perspective of visual data in real-time is disclosed. A electronic device accesses live visual data through a camera associated with an electronic device. The electronic device displays the live visual data on a display associated with the electronic device. The electronic device detects tilt data from a sensor associated with the electronic device, wherein tilt data indicates that the electronic device has tilted from an original angle to a current angle. In response to detecting tilt data from the sensor associated with the electronic device, the electronic devices alters the displayed live visual data to correct a live perspective of a live video feed.
Type:
Grant
Filed:
November 26, 2014
Date of Patent:
March 22, 2016
Assignee:
Visual Supply Company
Inventors:
Zachary Daniel Hodges, Robert A. Newport
Abstract: A photography apparatus includes: an imaging unit configured to image a subject and acquire photographed image data; a display unit configured to perform an image display; and a control unit; wherein the control unit executes reading processing for reading out, from a storage medium which stores template information arranged to fit and display photographed image data imaged by the imaging unit into a target region within display screen data according to a predetermined display format, the template information, wherein instruction information for instructing what sort of image should be photographed as the photographed image data to be fit and displayed in the target region is correlated therewith, and instruction information display control processing for controlling the display unit so as to display the instruction information in a correlated manner with the target region, in accordance with the template information.
Abstract: Embodiments are directed towards determining within a digital camera whether a pixel belongs to a foreground or background segment within a given image by evaluating a ratio of derivative and deviation metrics in an area around each pixel in the image, or ratios of derivative metrics across a plurality of images. For each pixel within the image, a block of pixels are examined to determine an aggregate relative derivative (ARD) in the block. The ARD is compared to a threshold value to determine whether the pixel is to be assigned in the foreground segment or the background segment. In one embodiment, a single image is used to determine the ARD and the pixel segmentation for that image. Multiple images may also be used to obtain ratios of a numerator of the ARD, useable to determine an extent of the foreground.
Abstract: An optoelectronic device (10) is provided having an image sensor (20) for generating pixel images of a detection area (12) and a brightness correction unit (28) configured to modify brightness values of the pixels with a correction factor (Hmul) to obtain a more homogeneously illuminated image. A respective correction factor (Hmul) is calculated for individual pixels or groups of pixels from a perspective transformation (M) which converts geometries of an object plane (34) in the detection area (12) into geometries of the image plane (32).
Type:
Grant
Filed:
June 3, 2013
Date of Patent:
February 23, 2016
Assignee:
SICK AG
Inventors:
Sascha Burghardt, Dietram Rinklin, Pascal Schuler, Stephan Walter
Abstract: Conventionally, in order to obtain a difference signal between an A+N signal and an N signal and a difference signal between an A+B+N signal and the A+N signal, the A+N signal needs to be held in two different capacitors. Hence, there is a problem in that, due to variations in capacitance of the two capacitors, the difference signal between the A+N signal and the N signal and the difference signal between the A+B+N signal and the A+N signal may not accurately be obtained. An imaging device generates a signal obtained by subtracting the same digital N signal from each of the digital A+N signal and the digital A+B+N signal.
Abstract: A first set of pixels of a short exposure image and a second set of pixels of a long exposure image may be obtained. The short exposure image may have been captured using a short total exposure time (TET) and the long exposure image may have been captured using a long TET. The long TET may be greater than the short TET. The first set of pixels and the second set of pixels may be aligned. A first pixel value of a first pixel in the first set of pixels and a second pixel of a second pixel in the second set of pixels value may be compared. Based on the comparison, an alignment error value for the first pixel and the second pixel may be determined. Based at least on the alignment error value, an output image may be provided.
Abstract: A photography device includes a plurality of cameras arranged as an array. The array may include multiple cameras with different focal distances. Each camera has a different focal distance. Or groups of cameras in an array may share multiple focal distances. The cameras may provide a similar field of view and similar magnification. A unified image is formed by combining the images from the different cameras.
Abstract: The image sensor 107 includes plural pixels each including a microlens and plural photoelectric conversion portions separated from one another with a separating zone thereamong and photoelectrically converting light fluxes passing through the microlens. The microlens includes a separating zone side lens portion overlapping the separating zone in an optical axis direction of the microlens. When the photoelectric conversion portions photoelectrically convert the light fluxes passing through mutually different areas of an exit pupil of an image capturing optical system, the separating zone side lens portion provides no power or a negative power for a light flux entering the separating zone side lens portion in the light fluxes entering the microlens.
Abstract: Pixels output a first signal based on signal charge of a part of photoelectric conversion units of multiple photoelectric conversion units, and a second signal based on signal charge of multiple photoelectric conversion units. An imaging apparatus outputs signals based on the first signals and signals based on the second signals by reducing the number of signals based on the first signals as compared to the number of signals based on the second signals.
Abstract: An display apparatus and a method of setting a view angle thereof are provided. The method includes in response to an occurrence of a predetermined event, displaying, on an area of a display screen, a view angle guiding user interface which guides setting a view angle of a camera connected to the display apparatus; and setting the view angle of the camera using the view angle guiding UI.
Type:
Grant
Filed:
February 8, 2013
Date of Patent:
December 29, 2015
Assignee:
SAMSUNG ELECTRONICS CO., LTD.
Inventors:
Sang-jin Han, Min-hyung Kim, Jung-geun Kim
Abstract: According to one embodiment, a noise reduction circuit includes a noise reduction filter for converting a pixel value of a pixel of interest through a calculation that uses the pixel value of the pixel of interest and pixel values of adjacent pixels. The noise reduction filter is set, for the calculation, with a heavier weighting for vertically adjacent pixels than that for horizontally adjacent pixels. The horizontally adjacent pixels are adjacent pixels that are located in parallel with the pixel of interest in a horizontal direction. The vertically adjacent pixels are adjacent pixels that are located in parallel with the pixel of interest in a vertical direction.
Abstract: Methods and apparatus for capturing and rendering high-quality photographs using relatively small, thin plenoptic cameras. Plenoptic camera technology, in particular focused plenoptic camera technology including but not limited to super-resolution techniques, and other technologies such as microsphere technology may be leveraged to provide thin form factor, megapixel resolution cameras suitable for use in mobile devices and other applications. In addition, at least some embodiments of these cameras may also capture radiance, allowing the imaging capabilities provided by plenoptic camera technology to be realized through appropriate rendering techniques.
Abstract: An imaging sensor is signaled to capture a digital image of a dark scene. For each of the pixel columns in the image, a respective column value is computed that represents at least some of the pixels in the column. For each of the pixel columns in the image, a respective comparison is made between the respective column value of the pixel column and a reference value. A respective column score is computed, for each of the pixel columns, based on the respective comparison. An indication that identifies one or more of the pixel columns as anomalous is stored, when the respective column score of the one or more the pixel columns does not meet a criterion. Other embodiments are also described and claimed.
Type:
Grant
Filed:
September 27, 2012
Date of Patent:
November 17, 2015
Assignee:
Apple Inc.
Inventors:
Richard L. Baer, Haitao Guo, Shannon L. Gardiner, Ting Chen
Abstract: An apparatus and a method for automatically adjusting a focus in an image capturing device are provided. The method includes generating an image by capturing a subject through a lens when a flash unit is enabled, dividing the image into a plurality of windows, determining a brightest window from among the plurality of windows, and setting an Auto Focus (AF) detection area for performing an AF function centering on the determined window.
Abstract: An image capture system including an image capture apparatus and an imaging lens detachable from the image capture apparatus comprises an image capture unit which captures an image of an object, an aperture which adjusts an amount of light that enters the image capture unit; a stepping motor of a 1-2 phase driving type, which is configured to drive the aperture, and a control unit which controls to set the stepping motor in a current applied state when the aperture is stopped down, and to drive the aperture by a difference between an aperture value while the aperture is stopped down and an aperture value for still image capture, when a still image capture instruction is issued while the aperture is stopped down.
Abstract: An estimated total camera motion between temporally proximate image frames is computed. A desired component of the estimated total camera motion is determined including distinguishing an undesired component of the estimated total camera motion, and including characterizing vector values of motion between the image frames. A counter is incremented for each pixel group having a summed luminance that is greater than a threshold. A counter may be decremented for pixels that are under a second threshold, or a zero bit may be applied to pixels below a single threshold. The threshold or thresholds is/are determined based on a dynamic luminance range of the sequence. The desired camera motion is computed including representing the vector values based on final values of counts for the image frames. A corrected image sequence is generated including the desired component of the estimated total camera motion, and excluding the undesired component.
Type:
Grant
Filed:
June 11, 2008
Date of Patent:
October 13, 2015
Assignee:
FotoNation Limited
Inventors:
Felix Albu, Corneliu Florea, Adrian Zamfir, Alexandru Drimbarean, Peter Corcoran