With Transition Or Edge Sharpening (e.g., Aperture Correction) Patents (Class 348/252)
  • Patent number: 11816811
    Abstract: An exemplary method includes a demosaic module receiving a frame of raw pixels having values in a first color space, generating vertical and horizontal color difference signals using information from the frame of raw pixels, generating reconstructed color pixel values for raw pixels that are missing captured color pixel values of a first color component of the first color space, transforming the captured and reconstructed color pixel values of the first color component to brightness pixel values in a second color space, and transforming the vertical and horizontal color difference signals into chrominance pixel values in the second color space.
    Type: Grant
    Filed: May 9, 2022
    Date of Patent: November 14, 2023
    Assignee: Intuitive Surgical Operations, Inc.
    Inventor: Wenyi Zhao
  • Patent number: 11809613
    Abstract: A high-resolution image sensor suitable for use in an augmented reality (AR) system to provide low latency image analysis with low power consumption. The AR system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object, selectively output imaging information for that region, and synchronously output high-resolution image frames. The region may be updated dynamically as the image sensor and/or the object moves. The image sensor may output the high-resolution image frames less frequently than the region being updated when the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an AR scene can be developed.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: November 7, 2023
    Assignee: Magic Leap, Inc.
    Inventors: Martin Georg Zahnert, Alexander Ilic
  • Patent number: 11599973
    Abstract: An image processing apparatus includes an information acquisition unit configured to acquire first optical information outside an image circle of an imaging optical system, and a processing unit configured to perform sharpening processing, based on the first optical information, for an input image generated by imaging using the imaging optical system. The first optical information is optical information generated based on second optical information within the image circle of the imaging optical system.
    Type: Grant
    Filed: May 19, 2020
    Date of Patent: March 7, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yoshiaki Ida
  • Patent number: 11593913
    Abstract: A method for correcting an image divides an output image into a grid with vertical sections of width smaller than the image width but wide enough to allow efficient bursts when writing distortion corrected line sections into memory. A distortion correction engine includes a relatively small amount of memory for an input image buffer but without requiring unduly complex control. The input image buffer accommodates enough lines of an input image to cover the distortion of a single most vertically distorted line section of the input image. The memory required for the input image buffer can be significantly less than would be required to store all the lines of a distorted input image spanning a maximal distortion of a complete line within the input image.
    Type: Grant
    Filed: June 6, 2022
    Date of Patent: February 28, 2023
    Inventors: Piotr Stec, Vlad Georgescu
  • Patent number: 11557108
    Abstract: An object is to provide a polygon detection device, a polygon detection method, and a polygon detection program to accurately detect a polygon resembling a reference polygon from an image. The polygon detection device acquires a ratio among lengths of sides of a reference polygon included in an appearance of a predetermined object. The polygon detection device acquires a photographic image of the predetermined object. The polygon detection device detects line segments from the acquired photographic image. The polygon detection device forms at least one polygon based on the detected line segments. The polygon detection device identifies, from the formed polygon, a polygon corresponding to the reference polygon based on a degree of similarity between a ratio among lengths of sides of the formed polygon and the acquired ratio among the lengths of sides of the reference polygon, among from the formed polygon.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: January 17, 2023
    Assignee: RAKUTEN GROUP, INC.
    Inventor: Yeongnam Chae
  • Patent number: 11403736
    Abstract: An image processing apparatus to execute a noise reduction process on an image includes setting and calculation units. The setting unit sets a parameter for a pixel of interest in the image. The calculation unit calculates a pixel value of the pixel of interest by using the parameter. Where the pixel of interest is not a pixel in a corner portion where two different edges intersect, the calculation unit averages a plurality of pixels, thereby calculating the pixel value of the pixel of interest subjected to the noise reduction process. Where the pixel of interest is a pixel included in the corner portion, the averaging is not executed and the pixel value of the pixel of interest is calculating by treating the pixel value of the pixel of interest as it is as the pixel value of the pixel of interest subjected to the noise reduction process.
    Type: Grant
    Filed: August 1, 2018
    Date of Patent: August 2, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Yohsuke Echizenya, Masaaki Kobayashi
  • Patent number: 11354773
    Abstract: A method for correcting an image divides an output image into a grid with vertical sections of width smaller than the image width but wide enough to allow efficient bursts when writing distortion corrected line sections into memory. A distortion correction engine includes a relatively small amount of memory for an input image buffer but without requiring unduly complex control. The input image buffer accommodates enough lines of an input image to cover the distortion of a single most vertically distorted line section of the input image. The memory required for the input image buffer can be significantly less than would be required to store all the lines of a distorted input image spanning a maximal distortion of a complete line within the input image.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: June 7, 2022
    Assignee: FotoNation Limited
    Inventors: Piotr Stec, Vlad Georgescu
  • Patent number: 11263724
    Abstract: A device for interpolating a color includes at least one processor to implement: a directions interpolation candidate values calculator configured to calculate third horizontal/vertical directions interpolation candidate values with respect to a pixel in a red (R) channel or a blue (B) channel on a Bayer color filter array pattern, based on a local gradient similarity between the R channel and a green (G) channel or a local gradient similarity between the B channel and the G channel; a directions interpolation weights calculator configured to calculate third horizontal/vertical directions interpolation weights based on the first horizontal/vertical directions interpolation candidate values by using a local complexity; and a G value interpolation execution unit configured to interpolate a G value of the pixel in the R channel or the B channel based on the calculated third horizontal/vertical directions interpolation candidate values and the third calculated horizontal/vertical directions interpolation weights.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: March 1, 2022
    Assignee: HANWHA TECHWIN CO., LTD.
    Inventor: Jun Ho Gal
  • Patent number: 11233947
    Abstract: Provided are an imaging apparatus capable of ensuring favorable visibility of display in a finder from when power is applied, a finder display control method of the imaging apparatus, and a finder display control program of the imaging apparatus. A viewfinder (30), which superimposes a display of a finder LCD (36) on an optical image of a subject observed through an observation optical system (32), includes a variable ND filter (40) that adjusts the light amount of the optical image of the subject. While power of the digital camera is turned off, information about the time is acquired, and the target transmittance of the variable ND filter (40) is updated on the basis of the information about the transmittance determined for each time zone. In a case where the target transmittance is updated, the variable ND filter (40) is driven to change the transmittance of the variable ND filter (40) to the target transmittance.
    Type: Grant
    Filed: April 29, 2020
    Date of Patent: January 25, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Kosuke Takahashi
  • Patent number: 11200751
    Abstract: Techniques to improve operation of an augmented reality device and/or system utilizing fiducial markers and/or colorspace conversions are provided. In various embodiments, one or more fiducial markers in an environment associated with the augmented reality device are updated and optimized in relation to environmental changes utilizing one or more color-space conversion techniques. Other embodiments are described and claimed.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: December 14, 2021
    Assignee: Capital One Services, LLC
    Inventors: Austin Grant Walters, Jeremy Edward Goodsitt, Reza Farivar
  • Patent number: 11196946
    Abstract: A smart binning circuit includes an edge information generator suitable for generating edge information from pixel data outputted from a pixel array; a weight allocator suitable for allocating a weight based on the edge information; a binning component suitable for generating a binning value by performing an edge detection interpolation (EDI) binning on the edge information; a bayer binning component suitable for generating an average value representing pixels that are down-scaled through a 4-sum binning operation; and a combiner suitable for combining the binning value and the average value according to the allocated weight.
    Type: Grant
    Filed: January 4, 2021
    Date of Patent: December 7, 2021
    Assignee: SK hynix Inc.
    Inventors: Su Ram Cha, Dong Ik Kim, Tae Hyun Kim, Seong Hee Park
  • Patent number: 11094045
    Abstract: According to aspects of the present disclosure, methods, systems, and media for processing an image are provided. A system may include at least one computer-readable storage medium including a set of instructions for processing an original image, and at least one processor in communication with the at least one computer-readable storage medium. When executing the set of instructions, the system is directed to obtain a first luminance image of the original image; decompose the first luminance image to provide a plurality of first decomposed images; adjust pixel frequencies in at least some of the plurality of first decomposed images to generate a plurality of second decomposed images; generate a second luminance image of the original image based on the plurality of second decomposed images; and determine a final image of the original image based on the first luminance image, the second luminance image, and the original image.
    Type: Grant
    Filed: December 13, 2018
    Date of Patent: August 17, 2021
    Assignee: ZHEJIANG DAHUA TECHNOLOGY CO., LTD.
    Inventors: Changjiu Yang, Xiaotao Jiang
  • Patent number: 10999541
    Abstract: To generate a favorable image that suppresses the occurrence of pattern noise in a method of performing patch-based noise reduction for a RAW image. In order to attain this object, the image processing apparatus of the present invention includes a pixel setting unit; a patch setting unit; and a noise reduction unit. Then, the pixel setting unit sets, for one pixel of interest, at least two kinds of pixel whose positions are different in a minimum unit of the color filter array as the plurality of reference pixels. Further, the patch setting unit sets, for one pixel of interest, at least two kinds of reference patch whose shapes are different.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: May 4, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuhiro Yahata
  • Patent number: 10726522
    Abstract: A method for correcting an image divides an output image into a grid with vertical sections of width smaller than the image width but wide enough to allow efficient bursts when writing distortion corrected line sections into memory. A distortion correction engine includes a relatively small amount of memory for an input image buffer but without requiring unduly complex control. The input image buffer accommodates enough lines of an input image to cover the distortion of a single most vertically distorted line section of the input image. The memory required for the input image buffer can be significantly less than would be required to store all the lines of a distorted input image spanning a maximal distortion of a complete line within the input image.
    Type: Grant
    Filed: January 24, 2018
    Date of Patent: July 28, 2020
    Assignee: FotoNation Limited
    Inventors: Piotr Stec, Vlad Georgescu
  • Patent number: 10699613
    Abstract: A method of voltage-programming a pixel circuit in a display panel to remove, before programming the pixel circuit, effects due to short-term effects such as caused by fast light transitions or effects due to previous pixel circuit measurements such as charge trapping. During a resetting cycle, the pixel circuit is programmed with a reset voltage value corresponding to a maximum or a minimum voltage value. Then, during a calibration cycle, the pixel circuit is programmed with a calibration voltage based on previously extracted data for the pixel circuit, a pixel current of the pixel circuit is measured, and the extracted data for the pixel circuit is updated based on the measured pixel current. Then, the pixel circuit is programmed with a video data that is calibrated with the updated extracted data. The pixel circuit is finally driven according to the programmed video data and emits a commensurate amount of light.
    Type: Grant
    Filed: March 2, 2016
    Date of Patent: June 30, 2020
    Assignee: Ignis Innovation Inc.
    Inventors: Gholamreza Chaji, Joseph Marcel Dionne, Yaser Azizi, Javid Jaffari, Abbas Hormati, Tong Liu, Stefan Alexander
  • Patent number: 10636127
    Abstract: A method and system for bidirectional edge highlighting. A memory receives an original input image. A processor calculates edge intensity for each edge pixel in the original input image. The processor also identifies strong edges and attenuates said strong edges. The processor can further determine whether the attenuated strong edges should be bright or dark based on the intensity of the pixel in the original image. The processor applies bidirectional edge highlighting to the image based on the intensity of the pixel in the original image. The degree of darkness or brightness of the highlighting is based on the calculated edge intensity after strong edge attenuation.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: April 28, 2020
    Assignee: United States of America as represented by Secretary of the Navy
    Inventor: Gregory K. Fleizach
  • Patent number: 10558860
    Abstract: A method for selecting important digital images in a collection of digital images, comprising: analyzing the digital images in the collection of digital images to identify one or more sets of similar digital images; identifying one or more sets of similar digital images having the largest number of similar digital images; selecting one or more digital images from the identified largest sets of similar digital images to be important digital images; and storing an indication of the selected important digital image in a processor accessible memory.
    Type: Grant
    Filed: November 28, 2017
    Date of Patent: February 11, 2020
    Assignee: KODAK ALARIS INC.
    Inventors: Stacie L. Hibino, Joseph A. Manico
  • Patent number: 10504487
    Abstract: Systems, methods, and computer readable media to improve the operation of display systems are described herein. In general, techniques are disclosed for ambient and content adaptive local tone mapping operations that improve display readability under bright ambient light conditions. More particularly, techniques disclosed herein improve contrast and brightness of dark image content while preserving bright areas. The disclosed architecture and operational methodologies generate high contrast images (e.g., amplifying dark regions while preserving bright content), preserve uniform backgrounds (e.g., static background pixels), are stabile in the face of local and global histogram changes (e.g., background not affected by small moving objects such as a mouse pointer), and provide near seamless fade-in and fad-out transitions.
    Type: Grant
    Filed: October 13, 2017
    Date of Patent: December 10, 2019
    Assignee: Apple Inc.
    Inventors: Tobias Jung, Marc Albrecht, Sean C. Chang
  • Patent number: 10437327
    Abstract: The invention relates to an eye tracking device (10a; 10b; 10c) comprising a processing unit (18) and an optical system (14), which comprises a capturing unit. The optical system (14) provides a first optical path (P; P1) with a first imaging property and a second optical path (P; P2) with a second imaging property and the capturing unit (C; C1, C2) captures a first image (24a) by capturing light that has passed along the first optical path (P; P1) and a second image (24b) by capturing light that has passed along the second optical path (P; P2), so that due to the difference of the first and second imaging property the first (24a) and the second image (24b) comprise a difference related to a characteristic of at least part of the first and the second image (24b), wherein the eye tracking device (10a; 10b; 10c) is configured to determine a property of the eye (12) on the basis of at least one of the first image (24a) and the second image (24b).
    Type: Grant
    Filed: May 4, 2016
    Date of Patent: October 8, 2019
    Assignee: APPLE INC.
    Inventors: Tom Sengelaub, Martin Haller, Jan Hoffmann
  • Patent number: 10365490
    Abstract: A head-mounted display (101) includes: an imaging assembly (203) imaging scenery seen by a user to generate a source picture; a storage unit (202) storing color correction factors used for correcting brightness of each of a red, green and blue color components included in a picture; a correction picture generator (212) performing color correction processing for enhancing a color component with a relatively low color correction factor stored in the storage unit (202), of the red, green and blue color components forming the source picture, to generate a correction picture; a picture display assembly (207) displaying the correction picture in the field of view of the user under a condition where he/she is able to perceive the outside world; and a special picture processor (213) performing picture processing for overlaying the correction picture and the source picture on each other for display.
    Type: Grant
    Filed: May 19, 2015
    Date of Patent: July 30, 2019
    Assignee: Maxell, Ltd.
    Inventors: Shingo Hayashi, Satoshi Ouchi, Yoshiho Seo, Tomoto Kawamura, Seiji Murata, Takahiro Matsuda, Toshiteru Nakamura
  • Patent number: 10304396
    Abstract: An image processing method includes detecting one or more edge regions in a plurality of input image frames; detecting movement of the edge region in the input image frames to generate a movement detecting result; and generating a plurality of output image frames by selectively smoothing at least a portion of the edge region at least according to the movement detecting result.
    Type: Grant
    Filed: June 23, 2017
    Date of Patent: May 28, 2019
    Assignee: Himax Display, Inc.
    Inventors: Kuo-Jung Lee, Mao-Jung Chung, Yuet Wing Li, Wen-Hsu Chen
  • Patent number: 10240982
    Abstract: A measurement apparatus includes an illumination unit configured to illuminate a measurement object with use of a plurality of point light sources configured to emit light based on illumination images modulated according to periodic functions out of phase with one another, an imaging unit configured to image the measurement object illuminated based on the illumination images, a first calculation unit configured to calculate phase information of a change in a luminance value at each of pixels based on a plurality of images captured by the imaging unit, and a first acquisition unit configured to acquire, from the phase information, a maximum reflection direction where a reflection direction is maximized on the measurement object.
    Type: Grant
    Filed: January 18, 2017
    Date of Patent: March 26, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Takuya Shimada
  • Patent number: 10122939
    Abstract: An image processing device processes image data and map data with regard to depth distribution of subjects. A decoding unit decodes encoded image data obtained by encoding image data of a subject image, and thereby generates decoded image data. Another decoding unit decodes encoded map data obtained by encoding map data and thereby generates decoded map data. A defocus map shaping unit acquires decoded image data and decoded map data, performs a shaping process of the decoded map data with reference to the decoded image data, and thereby generates shaped map data. A background blurring unit refers to the shaped map data and performs image processing of adding blur to a background of the decoded image.
    Type: Grant
    Filed: June 22, 2016
    Date of Patent: November 6, 2018
    Assignee: Canon Kabushiki Kaisha
    Inventor: Masaaki Matsuoka
  • Patent number: 10104361
    Abstract: A video processing unit and method for region adaptive smoothing. The image processing unit includes a memory and one or more processors. The one or processors are operably connected to the memory and configured to stitch together a plurality of video frames into a plurality of equirectangular mapped frames of a video. The one or processors are configured to define a top region and a bottom region for each of the equirectangular mapped frames of the video; perform a smoothing process on the top region and the bottom region for each of the equirectangular mapped frames of the video; and encode the smoothed equirectangular mapped frames of the video.
    Type: Grant
    Filed: November 13, 2015
    Date of Patent: October 16, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Madhukar Budagavi, Ankur Saxena, Jeffrey Wilkinson, John Furton, Andrew Dickerson, Guoxin Jin
  • Patent number: 10027856
    Abstract: To enable a receiving side to appropriately perform processing of obtaining display image data from transmission video data having a predetermined photoelectric conversion characteristic. Input video data is processing and transmission video data having a predetermined photoelectric conversion characteristic is obtained. Encoding processing is applied to the transmission video data and a video stream is obtained. A container of a predetermined format, including the video stream, is transmitted. Information indicating a photoelectric conversion of the input video data is inserted into the video stream and/or the container.
    Type: Grant
    Filed: March 3, 2016
    Date of Patent: July 17, 2018
    Assignee: SONY CORPORATION
    Inventor: Ikuo Tsukagoshi
  • Patent number: 9875678
    Abstract: An image display method is disclosed. In one aspect, the image display method includes receiving image data including a black region and a white region, determining a boundary between the black and white regions, determining a pixel to be corrected which is adjacent to the boundary, and determining a direction of the boundary and an arrangement of the black and white regions with respect to the boundary. The method also includes converting pixel data corresponding to the pixel into corrected pixel data based at least in part on the boundary direction and the arrangement and displaying images on a display device based at least in part on corrected image data including the corrected pixel data.
    Type: Grant
    Filed: December 3, 2014
    Date of Patent: January 23, 2018
    Assignee: Samsung Display Co., Ltd.
    Inventor: Min-Tak Lee
  • Patent number: 9866805
    Abstract: A spectrally mosaiced digital image is provided with missing color data imputed for each pixel. Circuitry is provided that is configured to perform at least a portion of the calculations related to demosaicing a high dynamic range image.
    Type: Grant
    Filed: February 1, 2010
    Date of Patent: January 9, 2018
    Assignee: GENTEX CORPORATION
    Inventors: Jon H. Bechtel, Jeremy C. Andrus, Tom B. Sherman
  • Patent number: 9817901
    Abstract: The present application describes performing a user initiated search query comprising receiving user input comprising description details of at least one desired object, retrieving a plurality of objects from a database sharing one or more of the description details of the user input, retrieving an image of the at least one desired object based on one or more of the plurality of objects, generating a contour of the image and comparing the generated contour with other related contours of other images stored in the database, displaying all of the available contours of all of the images that match the generated contour, receiving a selection of one of the available contours from the user and performing the search query based on the user selected contour.
    Type: Grant
    Filed: October 18, 2016
    Date of Patent: November 14, 2017
    Assignee: Open Invention Network LLC
    Inventors: Farid Khafizov, Margarita Khafizova
  • Patent number: 9736394
    Abstract: An image processing apparatus includes: an image acquisition unit configured to acquire a plurality of image data obtained by imaging a same subject; a saturation enhancement unit configured to execute saturation enhancement processing of enhancing saturation of at least a partial area of each of the plurality of image data; and a composite image generation unit configured to compare corresponding areas in the plurality of image data after the saturation enhancement processing to select an area having the highest saturation, and execute composition processing of generating composite image data formed of the selected area.
    Type: Grant
    Filed: February 23, 2016
    Date of Patent: August 15, 2017
    Assignee: Olympus Corporation
    Inventors: Koichi Shintani, Osamu Nonaka, Kunio Yamamiya, Masaomi Tomizawa
  • Patent number: 9734419
    Abstract: This invention provides a system and method to validate the accuracy of camera calibration in a single or multiple-camera embodiment, utilizing either 2D cameras or 3D imaging sensors. It relies upon an initial calibration process that generates and stores camera calibration parameters and residual statistics based upon images of a first calibration object. A subsequent validation process (a) acquires images of the first calibration object or a second calibration object having a known pattern and dimensions; (b) extracts features of the images of the first calibration object or the second calibration object; (c) predicts positions expected of features of the first calibration object or the second calibration object using the camera calibration parameters; and (d) computes a set of discrepancies between positions of the extracted features and the predicted positions of the features.
    Type: Grant
    Filed: December 30, 2008
    Date of Patent: August 15, 2017
    Assignee: COGNEX CORPORATION
    Inventors: Xiangyun Ye, Aaron S. Wallack, Guruprasad Shivaram, Cyril C. Marrion, David Y. Li
  • Patent number: 9681039
    Abstract: An image processing apparatus includes an acquisition unit configured to acquire a plurality of divided filters being configured such that a calculation result becomes a target filter to be applied to an input image, a filter processing unit configured to apply the plurality of divided filters to the input image to generate intermediate images for the plurality of respective divided filters, and an addition unit configured to add the intermediate images generated for the plurality of respective divided filters while shifting positions of the respective intermediate images so that positions of focused pixels of the plurality of respective divided filters align with a position of a focused pixel of the target filter to generate an output image, wherein the filter processing unit generates the intermediate images while changing an area to be used for performing calculation, for each of the plurality of divided filters.
    Type: Grant
    Filed: July 31, 2015
    Date of Patent: June 13, 2017
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Takashi Sasaki
  • Patent number: 9646383
    Abstract: An image processing apparatus includes an image processing intensity determination unit that determines an intensity of image processing and an image processing unit that performs the image processing to image information in accordance with the intensity determined by the image processing intensity determination unit. The image processing intensity determination unit determines the intensity of the image processing at a target pixel included in the image information on the basis of a depth value indicating a depth corresponding to the target pixel and a vertical position of the target pixel in the image information.
    Type: Grant
    Filed: December 19, 2012
    Date of Patent: May 9, 2017
    Assignee: Sharp Kabushiki Kaisha
    Inventors: Kei Tokui, Shigeaki Mizushima
  • Patent number: 9536214
    Abstract: A method, system, and computer program product for resource management are described. The method includes selecting trouble regions within the service area, generating clustered regions, and training a trouble forecast model for the trouble regions for each type of damage, the training for each trouble region using training data from every trouble region within the clustered region associated with the trouble region. The method also includes applying the trouble forecast model for each trouble region within the service area for each type of damage, determining a trouble forecast for the service area for each type of damage based on the trouble forecast for each of the trouble regions within the service area, and determining a job forecast for the service area based on the trouble forecast for the service area, wherein the managing resources is based on the job forecast for the service area.
    Type: Grant
    Filed: March 21, 2016
    Date of Patent: January 3, 2017
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Fook-Luen Heng, Zhiguo Li, Stuart A. Siegel, Amith Singhee, Haijing Wang
  • Patent number: 9503624
    Abstract: Provided is an optical imaging system capable of increasing diagnosis reliability and preciseness, and efficiently observing a target. The optical imaging system using multiple light sources according to an embodiment of the present invention includes a first light source generating a first light modulated with a first frequency, a second light source generating a second light modulated with a second frequency, a camera simultaneously detecting multiple lights output from an object after the first and second lights are illuminated on the object and outputting multiple image detecting signals, and an image processing unit processing the multiple image detecting signals to obtain a first image representing a shape of the object and a second image representing a desired target portion of the object.
    Type: Grant
    Filed: March 6, 2014
    Date of Patent: November 22, 2016
    Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
    Inventors: Eun-Ju Jeong, Bong Kyu Kim, Won Ick Jang, Chang-Geun Ahn, Hyun Woo Song
  • Patent number: 9456120
    Abstract: A method improves focus height repeatability in a machine vision inspection system. A region of interest is defined within a field of view imaged by a camera portion, wherein an aligned edge feature in the region of interest may introduce a focus height sensitivity that varies depending on the aligned edge feature offset relative to the image pixels. A first set of focus-determining operations determines a focus height for the region of interest, and comprise at least one of: (a) operations that reduce the sensitivity of the focus height determination to the offset of the aligned edge feature relative to the image pixels; and (b) operations that adjust the offset of the aligned edge feature relative to the image pixels according to a predetermined offset repeatability criteria, such that the image data used in the focus height determination fulfills the offset repeatability criteria.
    Type: Grant
    Filed: July 11, 2013
    Date of Patent: September 27, 2016
    Assignee: Mitutoyo Corporation
    Inventor: Mark Lawrence Delaney
  • Patent number: 9253418
    Abstract: Provided is an infrared image sensor for detecting infrared rays. The infrared image sensor includes a light-receiving unit including a pixel region in which a plurality of pixels are arranged and at least one reference pixel; a difference circuit for acquiring a first differential signal that is a differential signal between a signal of one pixel contained in the pixel region and a signal of the reference pixel and a second differential signal that is a differential signal between signals of two predetermined pixels out of the pixels contained in the pixel region; and a pixel signal calculating unit that calculates a signal of each of the pixels on the basis of the first differential signal and the second differential signal.
    Type: Grant
    Filed: March 9, 2012
    Date of Patent: February 2, 2016
    Assignee: HAMAMATSU PHOTONICS K.K.
    Inventors: Yoshihisa Warashina, Jun Suzuki
  • Patent number: 9160944
    Abstract: A signal processing apparatus may comprise: a pixel array where a plurality of pixels for storing data values are arranged; and a noise removing unit suitable for reflecting a data value of an adjacent pixel that is adjacent to a selected pixel, and a gain value depending on a data value of the selected pixel, on the data value of the selected pixel, and outputting the reflected data value of the selected pixel.
    Type: Grant
    Filed: October 30, 2013
    Date of Patent: October 13, 2015
    Assignee: SK Hynix Inc.
    Inventor: Young-Hwan Yun
  • Patent number: 9147266
    Abstract: An image processing apparatus comprises means for generating, from first-resolution image data including signals according to a plurality of color filters, second-resolution image data including signals according to the plurality of color filters at a resolution lower than the first-resolution image data; means for generating luminance signals from the signals according to the plurality of color filters of the second-resolution image data; means for storing image data including the luminance signals generated from the second-resolution image data; means for generating image data, which includes signals according to the plurality of color filters as many as the number of pixels of the first-resolution image data, from the stored image data and includes the luminance signals; and means for combining the signals according to the plurality of color filters of the first-resolution image data and signals according to the plurality of color filters of the image data output from the conversion means.
    Type: Grant
    Filed: November 2, 2011
    Date of Patent: September 29, 2015
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yoshiaki Honda
  • Patent number: 9049411
    Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.
    Type: Grant
    Filed: August 13, 2014
    Date of Patent: June 2, 2015
    Assignee: Pelican Imaging Corporation
    Inventors: Kartik Venkataraman, Amandeep S. Jabbi, Robert H. Mullis, Jacques Duparre, Shane Ching-Feng Hu
  • Publication number: 20150130973
    Abstract: An image-pickup optical system includes: a first lens provided near an aperture stop and configured to correct aberration; and a second lens arranged between the first lens and an image sensor and configured to collect light, the first lens being a gradient index lens. The degree of freedom of design of a gradient index lens is higher than that of a lens having a constant refractive index, and a gradient index lens thus has a high potential as a device for a lens. Because such a gradient index lens is employed, it is possible to correct aberration without performing expensive processing such as polishing for example. In other words, as a result, costs may be reduced and image-forming properties may not be reduced at the same time.
    Type: Application
    Filed: April 12, 2013
    Publication date: May 14, 2015
    Inventors: Masahiro Saito, Hidetoshi Kabasawa
  • Patent number: 9025058
    Abstract: An image processing apparatus includes an acquisition unit configured to acquire a first finite spatial filter having image resolution anisotropy, and a calculation unit configured to compute a second spatial filter by convolving a finite filter with respect to the first spatial filter, the finite filter having a sum of elements being 0 and at least two of the elements being non-0.
    Type: Grant
    Filed: April 16, 2013
    Date of Patent: May 5, 2015
    Assignee: Fujitsu Limited
    Inventors: Yukio Hirai, Hiroyasu Yoshikawa
  • Patent number: 9025053
    Abstract: An imaging apparatus restores a deteriorated image to a high-resolution image when the deteriorated image is restored based on a PSF image captured by an optical system. An imaging apparatus includes an optical system, and a PSF capturing unit that acquires point spread function (PSF) information captured by the optical system and outputs corrected PSF information. A subject capturing unit acquires subject information captured by the optical system and outputs the subject information; and an image restoration unit performs a restore operation for restoring the subject information, based on the corrected PSF information and the subject information. The PSF capturing unit subtracts a correction luminance value from the PSF information, and outputs the corrected PSF information. The correction luminance value is greater by a luminance value Is than a luminance value Nf of fixed value noise that does not fluctuate with time.
    Type: Grant
    Filed: April 20, 2011
    Date of Patent: May 5, 2015
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventor: Ichiro Oyama
  • Publication number: 20150116552
    Abstract: The present invention relates to a digital camera system comprising an image sensor for capturing digital images, an optical unit for forming an image onto the image sensor, the optical unit having a focus distance that can be varied between a minimum focus distance and a maximum focus distance, a control module for controlling the image sensor and the optical unit, an image processing module for processing captured images, and an image storage for storing captured images. The control module is configured to, upon receiving an order to capture an image, order the image sensor to capture a sequence of images while varying the focus distance between a first and a second focus distance and to store the sequence of captured images in the image storage, and the image processing module is configured to evaluate said sequence of images with regard to a defined criterion, to select at least one images from the sequence of images based on the result of the evaluation.
    Type: Application
    Filed: October 29, 2014
    Publication date: April 30, 2015
    Inventor: Jan KÅHRE
  • Publication number: 20150103214
    Abstract: An image sharpening processing method and apparatus, and a shooting terminal, where the method includes acquiring to-be-processed image; performing edge-preserving filtering processing on the image to obtain base image information and detail image information, where the base image information includes image edge information; determining, according to the image edge information, a sharpening gain required for performing sharpening processing on the detail image information; and performing sharpening processing on the detail image information using the sharpening gain. It is implemented that the sharpening gain required for sharpening processing is determined by the image edge information, thereby suppressing noise amplification and avoiding generating a phenomenon of overshoot for sharpened image information and improving quality of a sharpened image.
    Type: Application
    Filed: December 18, 2014
    Publication date: April 16, 2015
    Inventors: Gang Chen, Wei Luo, Congchao Zhu
  • Patent number: 8994882
    Abstract: Systems and methods may provide for conducting a real-time perceptual quality analysis of a video, wherein the perceptual quality analysis includes at least one of a noise measurement, a contrast measurement and a sharpness measurement. One or more strength parameters of one or more post-processing modules in a video processing pipe may be set based on the perceptual quality analysis resulting in overall video processing that adapts to the changing perceptual quality of the input. In one example, the strength parameters include at least one of a contrast parameter and a de-noising parameter. The invention results in visually enhanced video at the output of the post-processing module.
    Type: Grant
    Filed: December 9, 2011
    Date of Patent: March 31, 2015
    Assignee: Intel Corporation
    Inventors: Kalpana Seshadrinathan, Jorge E. Caviedes
  • Patent number: 8994856
    Abstract: Edge enhancement processing is implemented on an image data, and distortion correction processing is implemented on the image data subjected to the edge enhancement processing to correct a distortion by executing local enlargement processing or reduction processing corresponding to an optical distortion characteristic of a lens employed during an image pickup operation. At this time, the edge enhancement processing performed on the image data to be subjected to the distortion correction processing is modified in accordance with the local enlargement processing or reduction processing.
    Type: Grant
    Filed: October 19, 2010
    Date of Patent: March 31, 2015
    Assignee: Olympus Imaging Corp.
    Inventor: Manabu Ichikawa
  • Publication number: 20150085166
    Abstract: A camera apparatus includes a photogrammetric range sensor, small aperture lens and a processor configured to carry out a method for simulating a large aperture lens. The method includes capturing a photographic image data of a scene using the camera with the lens set to a small aperture size. Simultaneously or near-simultaneously with capturing the image, the camera captures photogrammetric range data pertaining to depth of objects in a field of view of the camera, using the range sensor. The processor then processes the photographic image data using the photogrammetric range data to obtain second photographic data simulating an image captured using a lens set to an aperture size larger than the small aperture size.
    Type: Application
    Filed: December 1, 2014
    Publication date: March 26, 2015
    Inventor: Gary Stephen Shuster
  • Patent number: 8957999
    Abstract: A method of suppressing a dark halo in an imager includes the steps of: extracting an edge value from an image; determining a chroma zone associated with the edge value extracted from the image; and modifying the edge value based on the chroma zone associated with the extracted edge value. The modified edge value from the imager is then provided to a user. The step of determining the chroma zone includes determining a chroma value of Cr and Cb in a Y-Cr-Cb color space; and modifying the edge value includes multiplying the edge value by a predetermined gain value, k, depending on the chroma value of Cr and Cb. If the value of Cr is greater than zero, then the gain value k is set close to zero, in order to suppress the dark halo in the modified edge value. On the other hand, if the value of Cr is less than zero, then the gain value k is set close to one, in order to sharpen the modified edge value in the image.
    Type: Grant
    Filed: June 16, 2011
    Date of Patent: February 17, 2015
    Assignee: Aptina Imaging Corporation
    Inventor: Yajie Sun
  • Patent number: 8941762
    Abstract: An image is obtained with reduced chromatic aberration as well as improved sharpness. An image processing apparatus includes image acquiring means configured to acquire an input image, and image restoration processing means configured to generate a restored image by calculating the input image and an image restoration filter that is based on a transfer function of an image pickup system that is used to form an object image as the input image, wherein the image restoration filter performs restoration so that when an object is a white point light source, a difference between spectra of two color components in the restored image is made smaller than a difference between spectra of the two color components in the input image.
    Type: Grant
    Filed: August 5, 2011
    Date of Patent: January 27, 2015
    Assignee: Canon Kabushiki Kaisha
    Inventor: Koshi Hatakeyama
  • Patent number: 8928783
    Abstract: An imaging apparatus includes an imaging lens configured to form a target optical image of a target, an imaging device configured to acquire a captured image by converting the target optical image formed by the imaging lens into image data by an imaging element, an image processor configured to perform image processing on the captured image acquired by the imaging device, and an image display configured to display an image obtained through the image processor, wherein the image processor has an edge extraction unit, a display processor, and a mode selection unit.
    Type: Grant
    Filed: September 25, 2012
    Date of Patent: January 6, 2015
    Assignee: Ricoh Company, Ltd.
    Inventor: Kazuhiro Yoshida