Color Balance (e.g., White Balance) Patents (Class 348/223.1)
  • Patent number: 11942013
    Abstract: Disclosed are techniques for improving the color uniformity of a display of a display device. A plurality of images of the display are captured using an image capture device. The plurality of images are captured in a color space, with each image corresponding to one of a plurality of color channels. A global white balance is performed to the plurality of images to obtain a plurality of normalized images. A local white balance is performed to the plurality of normalized images to obtain a plurality of correction matrices. Performing the local white balance includes defining a set of weighting factors based on a figure of merit and computing a plurality of weighted images based on the plurality of normalized images and the set of weighting factors. The plurality of correction matrices are computed based on the plurality of weighted images.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: March 26, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Kevin Messer, Miller Harry Schuck, III, Nicholas Ihle Morley, Po-Kang Huang, Nukul Sanjay Shah, Marshall Charles Capps, Robert Blake Taylor
  • Patent number: 11922687
    Abstract: An information processing apparatus, an information processing method, a non-transitory computer-readable medium, an a storage device for quantitatively analyzing and storing a relationship between an environment of a measurement target and a response of the measurement target with respect to the environment. The information processing apparatus includes a storage circuitry and an operation circuitry configured to acquire a first physical value by analyzing captured image information, the first physical value being indicative of an environment of a measurement target associated with a first pixel of the plurality of pixels, acquire a second physical value by analyzing the captured image information, the second physical value being indicative of a response of the measurement target with respect to the environment, and control the storage circuitry to store the first physical value and the second physical value in correlation with each other.
    Type: Grant
    Filed: July 5, 2019
    Date of Patent: March 5, 2024
    Assignee: Sony Group Corporation
    Inventor: Tetsu Ogawa
  • Patent number: 11895427
    Abstract: A method for generating a composite image comprises: detecting a color temperature of a background image; acquiring from a camera through an image signal processor, ISP, performing white balance correction of acquired image data, an image including a foreground region including face of a user; and detecting a color temperature of the foreground region. Responsive to the color temperature for the foreground region differing from that of the background image by more than a threshold amount, a color temperature for white balance correction of a subsequently acquired image is set which causes skin pixels within the foreground region of the subsequently acquired image to have a color temperature closer to the color temperature for the background image. Pixel values of the foreground region are combined with pixel values of the background image corresponding to a background region of the acquired image to provide the composite image.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: February 6, 2024
    Inventors: Razvan Condorovici, Andra Stan, Cosmin Stan
  • Patent number: 11889202
    Abstract: An image processing apparatus includes a detection unit configured to detect a specific area from a captured image, and a determination unit configured to determine, based on the detected specific area, a light source color including a characteristic color by using a learning unit trained in advance by machine learning.
    Type: Grant
    Filed: May 12, 2021
    Date of Patent: January 30, 2024
    Assignee: Canon Kabushiki Kaisha
    Inventor: Ryoji Arakawa
  • Patent number: 11843874
    Abstract: An electronic device is provided.
    Type: Grant
    Filed: November 25, 2022
    Date of Patent: December 12, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Kisuk Sung, Saetek Oh, Jaehyeok Choi, Sungoh Kim, Inyong Shim, Kihuk Lee
  • Patent number: 11804049
    Abstract: An autonomous vehicle is configured to detect an active turn signal indicator on another vehicle. An image-capture device of the autonomous vehicle captures an image of a field of view of the autonomous vehicle. The autonomous vehicle captures the image with a short exposure to emphasize objects having brightness above a threshold. Additionally, a bounding area for a second vehicle located within the image is determined. The autonomous vehicle identifies a group of pixels within the bounding area based on a first color of the group of pixels. The autonomous vehicle also calculates an oscillation of an intensity of the group of pixels. Based on the oscillation of the intensity, the autonomous vehicle determines a likelihood that the second vehicle has a first active turn signal. Additionally, the autonomous vehicle is controlled based at least on the likelihood that the second vehicle has a first active turn signal.
    Type: Grant
    Filed: March 25, 2021
    Date of Patent: October 31, 2023
    Assignee: Waymo LLC
    Inventors: Abhijit Ogale, Dave Ferguson
  • Patent number: 11800040
    Abstract: The present disclosure relates to a method performed by a deviation analyzing system (1) for black level drift assessment of a digital camera image sensor (21). The deviation analyzing system measures (1001) for pixels of an image captured by the image sensor, a respective luminance value and corresponding chromaticity value of each pixel. The deviation analyzing system further determines (1002) a respective average chromaticity value for differing luminance levels of the measured luminance values, based on for each luminance level averaging the corresponding measured chromaticity values. Moreover, the deviation analyzing system determines (1003), when the respective average chromaticity values of a range (4) of luminance levels indicate—to a predeterminable extent—chromaticity deviations (5) from the respective average chromaticity values (6) of other luminance levels (7), that a black level setting of the image sensor is drifted from a true black level.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: October 24, 2023
    Assignee: AXIS AB
    Inventors: Johan Jeppsson Karlin, Jimmie Jönsson
  • Patent number: 11785355
    Abstract: An image processing device includes an image sensor including a pixel array that includes a first pixel group, and a correlated double sampling circuit. The first pixel group includes a first plurality of normal pixels, a second plurality of normal pixels, and at least one first phase detection pixel. The correlated double sampling circuit is configured to generate first video data, based on charges of the first plurality of normal pixels, generate second video data, based on charges of the second plurality of normal pixels, and generate first phase detection data, based on an output of the at least one first phase detection pixel. The image processing device further includes an image signal processor configured to apply a first weight to the generated first video data, and apply a second weight to the generated second video data.
    Type: Grant
    Filed: September 14, 2021
    Date of Patent: October 10, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Young Heub Jang, Kundong Kim, Sungsu Kim, Hyungwook Kim, Jiyun Bang, Hankook Cho, Jaehyuk Hur
  • Patent number: 11778300
    Abstract: A display device and a white balance adjusting method of a photosensitive element of the display device are provided. The display device includes a display panel, the photosensitive element, and a driver integrated circuit (IC). A first white balance imaging parameter is color parameters of a preset image collected by the photosensitive element of the display device under a preset light source. A second white balance imaging parameter is color parameters of a preset image collected by a photosensitive element of a typical display device under the preset light source. The driver IC is configured to perform a white balance compensation on image data collected by the photosensitive element of the display device according to a deviation between the first white balance imaging parameter the second white balance imaging parameter.
    Type: Grant
    Filed: February 24, 2021
    Date of Patent: October 3, 2023
    Assignee: WUHAN CHINA STAR OPTOELECTRONICS SEMICONDUCTOR DISPLAY TECHNOLOGY CO., LTD.
    Inventors: Tao Zeng, Yang Wang
  • Patent number: 11750901
    Abstract: An image capturing apparatus having a touch panel mounted on a display unit on the rear side of its housing is provided with a posture detection unit; a first gripping unit positioned on side of the housing when the posture is a normal position; a second gripping unit positioned on side of the housing when the posture is a vertical position; a first operating member operable by a finger of a hand that is gripping the first gripping unit; a second operating member operable by a finger of a hand that is gripping the second gripping unit; and a control unit that displays a first button for deactivating operations from the second operating member on the display screen, and receives input to the first button via the touch panel.
    Type: Grant
    Filed: June 14, 2022
    Date of Patent: September 5, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yutaka Kojima
  • Patent number: 11735126
    Abstract: An electronic device such as a watch may include a display and a light sensor located behind the display. The light sensor may be used to measure the color of external objects. During color sampling operations, the display may emit light towards the external object in front of the display while the light sensor gathers color measurements. The display may emit light of different colors and the light sensor may detect an amount of reflected light for each color, which in turn may be used to determine the color of the external object. The control circuitry may use a watch-band-specific algorithm to determine the color of watch bands and may use a clothing-specific algorithm to determine the color of clothing. The control circuitry may display the color on the display so that the face of the watch matches the user's clothing or matches the user's watch band.
    Type: Grant
    Filed: July 19, 2021
    Date of Patent: August 22, 2023
    Assignee: Apple Inc.
    Inventors: Jackson K. Roland, Nicolas P. Bonnier, Alexandre Chapiro, David A. Doyle, Guillaume Lestoquoy, Jonathan C. Moisant-Thompson
  • Patent number: 11665433
    Abstract: In order to suppress degradation of color reproducibility in a visible light image or a composite image obtained by compositing the visible light image and an infrared light image, an image processing apparatus obtains a first image obtained by a first image capturing element that generates a visible-range image based on incident light from an imaging optical system, estimates received light intensity of infrared light that enters the first image capturing element, and controls a white balance adjustment on the first image based on the received light intensity estimated by the estimation unit.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: May 30, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Aihiko Numata
  • Patent number: 11649052
    Abstract: An aerial system, including a processing system, an optical system, an actuation system and a lift mechanism, includes an autonomous photography and/or videography system 70, implemented, at least in part, by the processing system 22, the optical system 26, the actuation system 28 and the lift mechanism 32. The autonomous photograph and/or videography system performs the steps of establishing a desired flight trajectory, detecting a target, controlling the flight of the aerial system as a function of the desired flight trajectory relative to the target using the lift mechanism and controlling the camera to capture pictures and/or video.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: May 16, 2023
    Assignee: Hangzhou Zero Zero Technology Co., Ltd.
    Inventors: Mengqiu Wang, Lixin Liu, Tong Zhang, Jia Lu
  • Patent number: 11625815
    Abstract: An image processing apparatus and a method are provided. The apparatus comprises a plurality of processing modules configured to operate in series to refine a raw image captured by a camera, the modules comprising a first module and a second module, each of which independently implements a respective trained artificial intelligence model, wherein: the first module implements an image transformation operation that performs an operation from the set comprising: (i) an essentially pixel-level operation that increases sharpness of an image input to the module, (ii) an essentially pixel-level operation that decreases sharpness of an image input to the module, (iii) an essentially pixel-block-level operation on an image input to the module; and the second module as a whole implements a different operation from the said set.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: April 11, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Gregory Slabaugh, Youliang Yan, Fenglong Song, Gang Chen, Jiangwei Li, Tao Wang, Liu Liu, Ioannis Alexiou, Ioannis Marras, Sean Moran, Steven George McDonagh, Jose Costa Pereira, Viktor Vladimirovich Smirnov
  • Patent number: 11600215
    Abstract: An image adjusting method of a display apparatus includes steps as follows: A plurality of preset grayscale-brightness relationship curves are determined corresponding to a plurality of time periods of a day, respectively. A reference grayscale-brightness relationship curve is selected from the preset grayscale-brightness relationship curves according to an acquisition time of an image data, corresponding to one of the time periods. A real-time ambient light is acquired, and it is compared with at least one of a reference contrast and a reference ambient light brightness corresponding to the reference grayscale-brightness relationship curve. At least one other grayscale-brightness relationship curve is selected from the preset grayscale-brightness relationship curves according to a comparison result to at least partially replace the reference grayscale-brightness relationship curve for adjusting the image data. The adjusted image data is then displayed.
    Type: Grant
    Filed: September 23, 2021
    Date of Patent: March 7, 2023
    Assignee: BenQ Corporation
    Inventor: Hsin-Nan Lin
  • Patent number: 11558593
    Abstract: A method and apparatus may be used for performing a scene-based automatic white balance correction. The method may include obtaining an input image. The method may include obtaining a raw image thumbnail. The method may include obtaining an augmented image thumbnail. The method may include computing a histogram from an image thumbnail. The method may include determining a scene classification. The method may include learning a filter. The filter may be learned from one or several different instances of the raw image thumbnail, the augmented image thumbnail, the scene classification, or any combination thereof. The method may include applying the filter to the histogram to determine white balance correction coefficients and obtain a processed image.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: January 17, 2023
    Assignee: GoPro, Inc.
    Inventors: Julien Caron, Thomas Armel Derbanne, Antoine Monod
  • Patent number: 11483497
    Abstract: An apparatus comprises a generating unit configured to generate a plurality of pieces of RAW data for respective exposure times from RAW data obtained from a sensor that can perform shooting at an exposure time that is different for each pixel, and an encoding unit configured to encode the generated plurality of pieces of RAW data.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: October 25, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Takafumi Murata, Shigeki Mochizuki, Ryota Suzuki
  • Patent number: 11470242
    Abstract: An image capture device obtains first image data from a front facing camera on a front face of the device including a display. The first image data represents a subject within a field of view of the image capture device. Facial recognition is performed in response to the first image data from the front facing camera. The front image data is used for determining whether any subject is a priority subject, of whom at least one priority subject image-indicative data is accessible by the image capture device. A region of interest is selected, corresponding to the subject determined to be a priority subject. Automatic focus, automatic exposure, or automatic white balance is performed using the selected region of interest. Second image data from the front facing camera are captured based on the automatic focus, automatic exposure, or automatic white balance using the selected region of interest.
    Type: Grant
    Filed: April 8, 2021
    Date of Patent: October 11, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Ravi Teja Mandavilli, Sravan Kumar Reddy Achamola, Kiran Koona, Kranthikumar Boggarapu
  • Patent number: 11455535
    Abstract: Systems and methods for sensor-independent illuminant determination are provided. In one embodiment of the method, the method includes receiving one or more training images in raw-RGB format; generating an input histogram from each of the inputted raw images; generating a learned mapping matrix that map raw images to a learned mapping space by passing the one or more input histograms to a trained first machine learning model; generating one or more mapped images by applying the learned mapping matrix to the one or more training images; generating a mapped histogram from each of the mapped images; and determining the result illuminant by passing the one or more mapped histograms as input into a second machine learning model. A final illuminant for an input image can be determined by applying the result illuminant to the input color space of the input image.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: September 27, 2022
    Inventors: Mahmoud Afifi, Michael Brown
  • Patent number: 11457190
    Abstract: An example of an information processing system includes a moving object including a camera and including a white area in an exterior of the moving object. An image capturing range of the camera includes the white area. It is determined whether or not each of pixels in a preset specified area that includes the white area in an image captured by the camera is white, and if the number of pixels that are white according to the white determination exceeds a predetermined number, white balance is performed to adjust the pixels that are white according to the white determination in the specified area closer to white.
    Type: Grant
    Filed: March 1, 2021
    Date of Patent: September 27, 2022
    Assignee: NINTENDO CO., LTD.
    Inventors: Shinichi Kinuwaki, François-Xavier Pasquier, Elie Abi Saad
  • Patent number: 11430204
    Abstract: There is provided an information processing device, an information processing method, and a program that make it possible to provide proper exposure control of a captured image. A matching section matches a feature point extracted from a captured image against a registered feature point stored in a predetermined storage section, and extracts a corresponding feature point in the captured image that corresponds to the registered feature point. A control section sets an exposure control value in accordance with an area image that is the image of an area near the corresponding feature point in the captured image. The present technology is applicable, for example, to an exposure control device that provides exposure control of a camera mounted on a mobile body.
    Type: Grant
    Filed: February 12, 2019
    Date of Patent: August 30, 2022
    Assignee: SONY CORPORATION
    Inventor: Yuya Yamaguchi
  • Patent number: 11418720
    Abstract: An apparatus includes an imaging unit configured to capture an image with an exposure time determined for each pixel or for each area including a plurality of pixels, a detection unit configured to detect a moving object area from the captured image, a calculation unit configured to calculate a luminance of each of a plurality of the pixels or the areas that is included in the detected moving object area, and a determination unit configured to determine, for each of the plurality of pixels or areas included in the moving object area, a different exposure time in a predetermined range based on the calculated luminance.
    Type: Grant
    Filed: February 16, 2021
    Date of Patent: August 16, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Takao Saito
  • Patent number: 11412195
    Abstract: A method and device for adjusting white balance and non-transitory computer readable storage medium are provided.
    Type: Grant
    Filed: September 12, 2019
    Date of Patent: August 9, 2022
    Assignee: SHENZHEN HEYTAP TECHNOLOGY CORP., LTD.
    Inventor: Quan Yuan
  • Patent number: 11410409
    Abstract: Provided is an image classification system for classifying an input image including: a network constructed so that feature amount extraction processing and fully connected processing are executed on input image data; a path extracting means configured to extract a processing path in the network; and a determination module configured to compare the processing path extracted by the path extracting means and a plurality of setting paths set in advance in association with classes to set a class associated with a matched path as a class of the input image.
    Type: Grant
    Filed: May 22, 2018
    Date of Patent: August 9, 2022
    Assignee: NITTO DENKO CORPORATION
    Inventor: Yoichi Kigawa
  • Patent number: 11412197
    Abstract: An electronic device includes: a display; a first image sensor configured to output a first image signal based on sensing a first light passing through the display; a second image sensor configured to output a second image signal based on sensing a second light that does not pass through the display; and a processor configured to: generate a first optical value and a second optical value based on the second image signal, the second optical value being different from the first optical value; based on the first optical value satisfying a first condition, correct the first image signal by using the second optical value.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: August 9, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sung-Ho Cha, Sung Su Kim
  • Patent number: 11394942
    Abstract: This apparatus includes a first processing circuit section that includes a tone controller that imparts tone curve characteristics for tone adjustment to an input video signal having linear characteristics; and a second processing circuit section that includes a first curve characteristics imparting section that imparts, to the video signal processed by the first processing circuit section, first curve characteristics for output, and generates a first output video signal.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: July 19, 2022
    Assignee: SONY CORPORATION
    Inventor: Koji Kamiya
  • Patent number: 11394913
    Abstract: The present technology is provided to accurately correct uneven luminance while suppressing an increase in the size of the solid-state imaging element. A pixel array unit includes a plurality of lines each including a predetermined number of pixels each being arrayed in a predetermined direction. An analog-to-digital conversion unit includes more than the predetermined number of analog-to-digital converters that convert analog signals into digital signals. A scanning circuit controls to sequentially select the plurality of lines and output more than the predetermined number of analog signals to the analog-to-digital conversion unit every time the line is selected. A correction unit performs black level correction processing on the digital signal.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: July 19, 2022
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventors: Atsumi Niwa, Shizunori Matsumoto, Eiji Hirata
  • Patent number: 11393429
    Abstract: A display device includes a storage unit, a display unit and a processing unit. The storage unit stores an original coordinate of a reference point and a color parameter under a color space, wherein the color space has been processed by color calibration in advance. The display unit displays an adjusting interface. The adjusting interface is configured to shift the reference point to generate a shift coordinate of the reference point. The processing unit is coupled to the storage unit and the display unit. The processing unit obtains a color transformation matrix according to the original coordinate of the reference point, the shift coordinate of the reference point and the color parameter. The processing unit adjusts three output percentages of RGB by the color transformation matrix.
    Type: Grant
    Filed: January 22, 2021
    Date of Patent: July 19, 2022
    Assignee: Qisda Corporation
    Inventors: Feng-Lin Chen, Chun-Chang Wu
  • Patent number: 11388346
    Abstract: An apparatus configured to control an exposure of a capturing unit includes a determination unit configured to determine an object region from a first image captured by the capturing unit and containing a predetermined object, an acquisition unit configured to acquire a region having a similar luminance value to a luminance value of the determined object region from a region other than the object region, and an adjustment unit configured to adjust the exposure of the capturing unit based on a luminance value of the region acquired by the acquisition unit in a second image captured by the capturing unit.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: July 12, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Shogo Kinugawa
  • Patent number: 11368603
    Abstract: Provided is an image processing device which has: an image input part configured to input a multi-spectral image which includes N (N is an integer of 4 or more) channels corresponding to N bands; a reference vector setting part configured to cause a user to set, as three reference vectors, three types of N-dimensional vectors having sensitivities of the respective N bands as elements; and a conversion part configured to convert the multi-spectral image into a 3-channel image including three channels by decomposing a spectral distribution of each pixel of the multi-spectral image on the basis of the three reference vectors.
    Type: Grant
    Filed: May 22, 2019
    Date of Patent: June 21, 2022
    Assignee: OMRON Corporation
    Inventor: Yutaka Kato
  • Patent number: 11363244
    Abstract: The present disclosure relates to systems and methods for image white balance adjustment. The systems may perform the methods to obtain a target image; determine a first lighting condition of the target image when the target image is captured; determine, based on the first lighting condition of the target image, a white balance gain of the target image; and adjust, based on the white balance gain, white balance of the target image.
    Type: Grant
    Filed: October 11, 2020
    Date of Patent: June 14, 2022
    Assignee: ZHEJIANG DAHUA TECHNOLOGY CO., LTD.
    Inventor: Tingniao Wang
  • Patent number: 11330148
    Abstract: Provided is an image processing device which has: an image input part configured to input a multi-spectral image which includes N (N is an integer of 4 or more) channels corresponding to N bands; a reference vector setting part configured to cause a user to set, as three reference vectors, three types of N-dimensional vectors having sensitivities of the respective N bands as elements; and a conversion part configured to convert the multi-spectral image into a 3-channel image including three channels by decomposing a spectral distribution of each pixel of the multi-spectral image on the basis of the three reference vectors.
    Type: Grant
    Filed: May 22, 2019
    Date of Patent: May 10, 2022
    Assignee: OMRON Corporation
    Inventor: Yutaka Kato
  • Patent number: 11330685
    Abstract: The present invention discloses a method, device, terminal setting and readable storage medium for correcting mixed color. The method first acquiring color coordinates of standard mixed color and color coordinates of mixed color to be corrected, when the first difference coordinates of the two color coordinates exceed preset threshold, calculating a ratio of Y coordinate and X coordinate of the first difference coordinates to obtain first ratio, calculating coordinates difference between the first color coordinates and color coordinates of each monochromatic light to obtain difference coordinates to be processed, calculating ratios of Y coordinate and X coordinate of each difference coordinates to be processed to obtain ratios to be processed, selecting monochromatic light corresponding to a ratio to be processed with the smallest difference from the first ratio as monochromatic light to be adjusted, then realizing color correction by adjusting color channel value of the monochromatic light to be adjusted.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: May 10, 2022
    Assignee: GUANGZHOU YAJIANG PHOTOELECTRIC EQUIPMENT CO., LTD.
    Inventors: Zhiman Chen, Rongfeng Huang, Guohai Wang
  • Patent number: 11323676
    Abstract: One limitation of traditional imaging systems is that they are only programmed to correct for a single color of illuminant in a scene. In multi-illuminant scenes, the detected illuminant color may correspond to some mixture of scene illuminants. This may lead to incomplete color correction, wherein, e.g., the dominant illuminant is corrected for but the color cast caused by secondary illuminants is still visible, or an at least partially visible color cast remains from multiple of the scene illuminants. Thus, the techniques disclosed herein comprise: obtaining an image of a scene; generating an illumination map for the obtained image; dividing the values in the illumination map to determine a number of estimated illuminant regions, wherein each region corresponds to at least one estimated illuminant present in the captured scene; estimating a white point for each region; and applying white balancing operations, based on the estimated white points for each region.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: May 3, 2022
    Assignee: Apple Inc.
    Inventors: Ilya Romanenko, Roberto Montagna
  • Patent number: 11323666
    Abstract: An imaging device and a method for capturing images under water and dynamically adjusting gain values for use in color correction. Minimum and maximum gain values as a function of depth are provided and a value of a parameter indicative of a point in a range between minimum and maximum gain values for a water depth is dynamically adjusted based on white balance analysis of the last captured image. A current gain value for a color of the color filter array is then determined based on the stored minimum and maximum gain values, the determined water depth, and the current parameter value and applied in the image/video pipeline to color correct the next image.
    Type: Grant
    Filed: November 11, 2021
    Date of Patent: May 3, 2022
    Assignee: Paralenz Group ApS
    Inventor: Nikolaj Bech Andersen
  • Patent number: 11323631
    Abstract: An image capturing device includes: an illuminator configured to generate illumination light having wavelength bands and an illumination characteristic; an imager configured to generate an image signal by capturing light from a subject; and a processor configured to: control the illumination characteristic; set a piece of statistical data used for estimating a spectral characteristic of the subject included in the image signal; estimate the spectral characteristic of the subject included in the image signal based on the set piece of statistical data; define an illumination characteristic of illumination light in accordance with the estimated spectral characteristic of the subject; and determine whether or not the set piece of statistical data is an adequate piece of statistical data based on whether or not an image signal generated by the imager under the illumination light having the defined illumination characteristic satisfies a criterion for achromatic color.
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: May 3, 2022
    Assignee: OLYMPUS CORPORATION
    Inventors: Masanori Mitsui, Takuji Horie, Joji Sakamoto
  • Patent number: 11308341
    Abstract: In a verification method for verifying a verification target camera, an original image in which optical characteristics of an original image camera different from the verification target camera are corrected to a captured image of a real scene captured by the original image camera is prepared, a verification image in which an influence of optical characteristics of the verification target camera is applied to the original image is prepared, image recognition of the verification image is performed by executing a verification target algorithm applied for image recognition of an image captured by the verification target camera, and an image recognition result of the verification image is evaluated.
    Type: Grant
    Filed: May 1, 2020
    Date of Patent: April 19, 2022
    Assignee: DENSO CORPORATION
    Inventor: Toshiyuki Tsuchimoto
  • Patent number: 11302283
    Abstract: The present disclosure provides a screen color conversion method, a storage medium, and an electronic device. The method can include when an adjustment operation for a correlated color temperature of a color in a screen is triggered, determining target Red-Green-Blue (RGB) coefficients according to a relation curve between the RGB coefficients and a correlated color temperature, and a target correlated color temperature corresponding to the adjustment operation. The relation curve reflects a relation between a tristimulus value of a white color displayable for the screen and a correlated color temperature determined based on a black body radiation locus, and a target conversion matrix between the tristimulus value and the RGB coefficients. The method can further include converting the color in the screen to a target color corresponding to the target correlated color temperature according to the target RGB coefficient.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: April 12, 2022
    Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
    Inventors: Xiaohuang Su, Dong Zhai
  • Patent number: 11290652
    Abstract: To make a difference between respective accumulation conditions of first and second regions of a live view image and then to check the live view image for changes in an image corresponding to the changes in the accumulation conditions of the respective regions. An electronic apparatus includes an image-capture unit and a system control unit. The image-capture unit includes an image sensor and captures an image of first and second regions. The system control unit causes a display unit to display a live view image corresponding to the image of the first and second regions captured by the image-capture unit. The system control unit also makes a difference between respective accumulation conditions of the first and second regions of the live view image.
    Type: Grant
    Filed: May 31, 2013
    Date of Patent: March 29, 2022
    Assignee: NIKON CORPORATION
    Inventor: Takeshi Nishi
  • Patent number: 11281078
    Abstract: There are provided a plurality of terminals disposed in a circumferential direction of a second mount of an image capturing apparatus. The plurality of terminals correspond to a plurality of terminals disposed in a circumferential direction of a first mount of an accessory. The plurality of terminals of the image capturing apparatus include a first terminal used to supply power for driving an internal component of the accessory, and a second terminal used to supply power for controlling communication with the accessory. The first and second terminals are disposed further in a mount direction of the accessory than the other terminals of the image capturing apparatus on a predetermined stage of the terminal holder. An inter-terminal pitch between the first and second terminals is wider than at least one pitch among inter-terminal pitches of the other terminals.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: March 22, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Jun Kamiya, Yasuyuki Watazawa, Naoto Fujihashi
  • Patent number: 11284013
    Abstract: A terminal device calibrates a to-be-detected image based on a light source color temperature and scene brightness that are obtained during imaging of the to-be-detected image and based on a preset reference color card image set to restore a real color of the to-be-detected image to a greatest extent.
    Type: Grant
    Filed: June 30, 2017
    Date of Patent: March 22, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Henghui Lu, Hao Liu, Wenmei Gao
  • Patent number: 11272095
    Abstract: An image processing apparatus includes an image acquire unit that acquires an image in which at least one element in a first color space has linear characteristics; and a processor. The processor is configured to adjust a white balance of the image which is acquired by the image acquire unit; control the adjustment of the white balance, on the basis of a specific color serving as a reference; convert each of a plurality of portions in the image in which the white balance has been controlled by the adjustment of the white balance, into one element in a second color space; and apply predetermined image processing to the acquired image in which the white balance has not been adjusted, by using the converted information.
    Type: Grant
    Filed: July 14, 2020
    Date of Patent: March 8, 2022
    Assignee: CASIO COMPUTER CO., LTD.
    Inventor: Takeshi Tsukagoshi
  • Patent number: 11265518
    Abstract: A method apparatus are directed to identify items disposed on the bottom shelf of a shopping cart bottom of basket (BoB). Certain aspects envision a distance measurement sensor and computing system connected to the shopping cart. A first set of distance measurements of the bottom shelf when empty is obtained via the distance measurement sensor. Next, at a checkout stand, a second set of distance measurements of the shelf are taken, which can be used to compare with the first set of distance measurements to identify if there is an object on the BoB. An alert can be provided to a checkout attendant if there is an object on the BoB.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: March 1, 2022
    Assignee: BOB Profit Partners LLC
    Inventors: Dale Lee Yones, Scott David Dalgleish, Craig W. Moyer
  • Patent number: 11265524
    Abstract: An apparatus configured to correct a captured image using a gloss component based on a virtual light source sets a light-source color of the virtual light source. The apparatus generates the gloss component on a subject in the captured image using the light-source color corrected according to a color tone of the captured image. The apparatus corrects the captured image by adding the generated gloss component to the captured image.
    Type: Grant
    Filed: October 15, 2020
    Date of Patent: March 1, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yuichi Nakada
  • Patent number: 11244977
    Abstract: An imaging sensor comprises: an array of light-detecting elements, wherein each light-detecting element in the array of light-detecting elements is arranged in the imaging sensor so as to detect a respective wavelength interval, wherein the respective wavelength interval differs for different light-detecting elements; a pattern arranged on the array of light-detecting elements, wherein the pattern defines a plurality of transparent areas, each transparent area being associated with a corresponding light-detecting element in the array of light-detecting elements, wherein a size of a transparent area among the plurality of transparent areas is dependent of the corresponding light-detecting element with which the transparent area is associated.
    Type: Grant
    Filed: December 19, 2017
    Date of Patent: February 8, 2022
    Assignee: IMEC VZW
    Inventors: Nicolaas Tack, Bert Geelen, Bart Vereecke
  • Patent number: 11226232
    Abstract: A Multichromatic Calibration (MC) method of at least a spectral sensor which is one of a list comprising at least a spectrometer, a multispectral sensor, a hyperspectral sensor, a spectral camera, a color camera. The method comprises a. generating a plurality of different multichromatic spectra, wherein i. a spectrum from the plurality of different multichromatic spectra contains light intensity measurable by the at least one spectral sensor and by a reference spectral device, and ii. a spectrum from the plurality of different multichromatic spectra contains light centered around at least two different wavelengths and is configured to be integrated during an exposure time of a single measurement from any of the at least one spectral sensor or the reference spectral device; b.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: January 18, 2022
    Assignee: ECOLE POLYTECHNIQUE FÉDÉRALE DE LAUSANNE (EPFL)
    Inventors: Dragos Constantin, Simon De Visscher
  • Patent number: 11216981
    Abstract: In one aspect, a system for calibrating image data during the performance of an agricultural operation may include an imaging device configured to capture image data associated with a portion of a field within a field of view of the imaging device. Additionally, the system may include a color indicator positioned within the field of view of the imaging device. Moreover, the system may include a controller configured to receive the image data from the imaging device and determine an apparent color value of the color indicator based on the received image data. Furthermore, the controller may be configured to adjust at least one of an operating parameter of the imaging device or a variable associated with processing the received image data based on the determined apparent color value.
    Type: Grant
    Filed: July 26, 2019
    Date of Patent: January 4, 2022
    Assignee: CNH Industrial America LLC
    Inventors: Luca Ferrari, Trevor Stanhope
  • Patent number: 11212456
    Abstract: Image capturing, including: generating a pattern of light projection to be projected during non-video capture segments, wherein the pattern of light projection is not projected during video capture segments; determining timing of the non-video capture segments; projecting the generated pattern of light onto a capture volume during the non-video capture segments for a period less than a length of one non-video capture segment; capturing image data of the projected pattern of light using at least one image sensor; and processing the captured image data to obtain information about objects and people in the capture volume.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: December 28, 2021
    Assignees: SONY GROUP CORPORATION, SONY PICTURES ENTERTAINMENT INC.
    Inventor: Scot Barbour
  • Patent number: 11212500
    Abstract: An image capture apparatus includes: an acquisition unit configured to acquire image data of a subject; an identification unit configured to identify a color temperature of light from the subject on the basis of the image data acquired by the acquisition unit; an adjustment unit configured to adjust a white balance of the image data on the basis of the color temperature identified by the identification unit; and a suppression unit configured to suppress a chroma of the image data applied adjustment by the adjustment unit on the basis of the color temperature identified by the identification unit if image data of a specific light-emitting body is included in the image data.
    Type: Grant
    Filed: December 5, 2018
    Date of Patent: December 28, 2021
    Assignee: NIKON CORPORATION
    Inventors: Takatoshi Morikawa, Norimitsu Anada
  • Patent number: 11205331
    Abstract: A device and a method for providing an indication to a user regarding events associated with a device. A method includes detecting a plurality of events associated with a device and communicating the detected events to a controller of the device. The method includes generating a command for each of the detected events and communicating the command to a voltage generator of the device. The method includes generating voltage based on the command and applying the generated voltage to one or more electro-chromic layers of a plurality of electro-chromic layers embedded in the device. The method includes glowing a color by the one or more electro-chromic layers on the device by application of the generated voltage.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: December 21, 2021
    Assignee: CARRIER CORPORATION
    Inventors: Srinivasa Reddy Pilli, Prasad Babu Lakshmipathy, Raghuveer Pallerla