Patents by Inventor Jarno Nikkanen

Jarno Nikkanen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12108159
    Abstract: Method and device are provided for camera control to acquire an image. The method includes: acquiring a stream of image frames by an image sensor comprising at least one frame; acquiring a target frame by the image sensor; determining scene information in the target frame; selecting a reference frame from the stream of image frames by identifying the scene information of the target frame in the reference frame; determining at least one acquisition parameter of the reference frame; and acquiring a final image from the target frame with the acquisition parameters.
    Type: Grant
    Filed: June 30, 2022
    Date of Patent: October 1, 2024
    Assignee: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
    Inventors: Jarno Nikkanen, Jiaqi Guo
  • Publication number: 20230058934
    Abstract: Method and device are provided for camera control to acquire an image. The method includes: acquiring a stream of image frames by an image sensor comprising at least one frame; acquiring a target frame by the image sensor; determining scene information in the target frame; selecting a reference frame from the stream of image frames by identifying the scene information of the target frame in the reference frame; determining at least one acquisition parameter of the reference frame; and acquiring a final image from the target frame with the acquisition parameters.
    Type: Application
    Filed: June 30, 2022
    Publication date: February 23, 2023
    Applicant: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
    Inventors: Jarno NIKKANEN, Jiaqi GUO
  • Patent number: 11457191
    Abstract: A method, apparatus, and a non-transitory computer-readable storage medium for temporally stabilizing White Point (WP) information in an Auto White Balance (AWB) process. The method may include receiving lux level, AWB statistics, and input WP. The method also include generating a histogram of the AWB statistics. The method may also include generating, from the histogram, a confidence value for the input WP. The method may also include determining a major colour count. The method may also include determining a threshold value based on the major colour count and the lux level. The method may also include setting an update state to locked when the confidence value is below the threshold value and otherwise setting it to unlocked. The final WP information is obtained from a previous frame when the update state is locked and otherwise from the input WP information.
    Type: Grant
    Filed: July 7, 2021
    Date of Patent: September 27, 2022
    Assignee: Beijing Xiaomi Mobile Software Co., Ltd.
    Inventors: Vladislav Uzunov, Andriy Bazhyna, Miikka Tuppurainen, Tapio Finnila, Jarno Nikkanen
  • Publication number: 20220094898
    Abstract: A method, apparatus, and a non-transitory computer-readable storage medium for temporally stabilizing White Point (WP) information in an Auto White Balance (AWB) process. The method may include receiving lux level, AWB statistics, and input WP. The method also include generating a histogram of the AWB statistics. The method may also include generating, from the histogram, a confidence value for the input WP. The method may also include determining a major colour count. The method may also include determining a threshold value based on the major colour count and the lux level. The method may also include setting an update state to locked when the confidence value is below the threshold value and otherwise setting it to unlocked. The final WP information is obtained from a previous frame when the update state is locked and otherwise from the input WP information.
    Type: Application
    Filed: July 7, 2021
    Publication date: March 24, 2022
    Applicant: BEIJING XIAOMI MOBILE SOFTWARE CO., LTD.
    Inventors: Vladislav UZUNOV, Andriy BAZHYNA, Miikka TUPPURAINEN, Tapio FINNILA, Jarno NIKKANEN
  • Patent number: 10916036
    Abstract: A method, system, and article is directed to generating multi-exposure camera statistics for image processing by rearranging and sampling image data of multiple exposure images.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: February 9, 2021
    Assignee: Intel Corporation
    Inventors: Jarno Nikkanen, Rastislav Lukac
  • Patent number: 10791310
    Abstract: A system, article, and method to perform deep learning-based automatic white balancing uses a neural network in conjunction with other non-neural network automatic white balancing algorithms.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: September 29, 2020
    Assignee: Intel Corporation
    Inventors: Jarno Nikkanen, Lauri Suomela, Joni-Matti Määttä
  • Patent number: 10630954
    Abstract: A method, system, and apparatus are described. The method includes calculating, via a white balancer, a candidate illumination chromaticity estimate for a current frame and calculating, via a scene prior monitor, a scene prior chromaticity for the current frame as a weighted sum of a scene prior chromaticity from a previous frame and a candidate illumination chromaticity estimate. The method also includes calculating, via a scene invariant illumination chromaticity controller, a final illumination chromaticity for the current frame as a weighted sum of a scene illumination chromaticity for the current frame and the candidate illumination chromaticity estimate.
    Type: Grant
    Filed: December 28, 2017
    Date of Patent: April 21, 2020
    Assignee: Intel Corporation
    Inventors: Evgeny Krestyannikov, Jarno Nikkanen
  • Patent number: 10616511
    Abstract: A method, system, and article is directed to camera control and image processing with a multi-frame-based window for image data statistics.
    Type: Grant
    Filed: June 8, 2017
    Date of Patent: April 7, 2020
    Assignee: Intel Corporation
    Inventors: Liron Ain-Kedem, Jarno Nikkanen
  • Patent number: 10477177
    Abstract: An embodiment of a semiconductor package apparatus may include technology to determine first scene chromaticity information for a frame of a video sequence, determine second scene chromaticity information for another frame of the video sequence, determine a scene content change based on the first and second scene chromaticity information, and determine a global illumination change based on the first and second scene chromaticity information. Other embodiments are disclosed and claimed.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: November 12, 2019
    Assignee: Intel Corporation
    Inventors: Noha El-Yamany, Jarno Nikkanen
  • Publication number: 20190156516
    Abstract: A method, system, and article is directed to generating multi-exposure camera statistics for image processing by rearranging and sampling image data of multiple exposure images.
    Type: Application
    Filed: December 28, 2018
    Publication date: May 23, 2019
    Applicant: Intel Corporation
    Inventors: Jarno Nikkanen, Rastislav Lukac
  • Publication number: 20190045164
    Abstract: An embodiment of a semiconductor package apparatus may include technology to determine first scene chromaticity information for a frame of a video sequence, determine second scene chromaticity information for another frame of the video sequence, determine a scene content change based on the first and second scene chromaticity information, and determine a global illumination change based on the first and second scene chromaticity information. Other embodiments are disclosed and claimed.
    Type: Application
    Filed: December 15, 2017
    Publication date: February 7, 2019
    Applicant: Intel Corporation
    Inventors: Noha El-Yamany, Jarno Nikkanen
  • Publication number: 20190045163
    Abstract: A system, article, and method to perform deep learning-based automatic white balancing uses a neural network in conjunction with other non-neural network automatic white balancing algorithms.
    Type: Application
    Filed: October 2, 2018
    Publication date: February 7, 2019
    Applicant: Intel Corporation
    Inventors: Jarno Nikkanen, Lauri Suomela, Joni-Matti Määttä
  • Publication number: 20190045161
    Abstract: A method, system, and apparatus are described. The method includes calculating, via a white balancer, a candidate illumination chromaticity estimate for a current frame and calculating, via a scene prior monitor, a scene prior chromaticity for the current frame as a weighted sum of a scene prior chromaticity from a previous frame and a candidate illumination chromaticity estimate. The method also includes calculating, via a scene invariant illumination chromaticity controller, a final illumination chromaticity for the current frame as a weighted sum of a scene illumination chromaticity for the current frame and the candidate illumination chromaticity estimate.
    Type: Application
    Filed: December 28, 2017
    Publication date: February 7, 2019
    Applicant: Intel Corporation
    Inventors: Evgeny Krestyannikov, Jarno Nikkanen
  • Publication number: 20180359410
    Abstract: A method, system, and article is directed to camera control and image processing with a multi-frame-based window for image data statistics.
    Type: Application
    Filed: June 8, 2017
    Publication date: December 13, 2018
    Inventors: Liron Ain-Kedem, Jarno Nikkanen
  • Patent number: 10070042
    Abstract: Techniques related to self-calibration for phase detection autofocus.
    Type: Grant
    Filed: December 19, 2016
    Date of Patent: September 4, 2018
    Assignee: Intel Corporation
    Inventors: Jarno Nikkanen, Liron Ain-Kedem
  • Publication number: 20180176452
    Abstract: Techniques related to self-calibration for phase detection autofocus.
    Type: Application
    Filed: December 19, 2016
    Publication date: June 21, 2018
    Inventors: Jarno NIKKANEN, Liron AIN-KEDEM
  • Patent number: 9848118
    Abstract: An example sensor for phase detection autofocus includes a number of photodiodes to capture light in a number of wavelengths. The example sensor also further includes a color filter array including a grid of alternating color pass filters corresponding to the number of photodiodes. The example sensor further includes a mask including a number of filters to separate a band of light by blocking the band of light on opposing portions of at least two of the alternating color pass filters.
    Type: Grant
    Filed: March 11, 2016
    Date of Patent: December 19, 2017
    Assignee: Intel Corporation
    Inventors: Mikko Ollila, Jarno Nikkanen
  • Patent number: 9826149
    Abstract: Methods, apparatuses and systems may provide for operating a machine learning device by obtaining training image data, conducting an offline prediction analysis of the training image data with respect to one or more real-time parameters of an image capture device, and generating one or more parameter detection models based on the offline prediction analysis. Additionally, methods, apparatuses and systems may provide for operating the image capture device by obtaining a candidate image associated with the image capture device, determining that the candidate image corresponds to a particular type of scene represented in a parameter prediction model, and adjusting one or more real-time parameters of the image capture device based at least in part on one or more parameter values associated with the particular type of scene.
    Type: Grant
    Filed: March 27, 2015
    Date of Patent: November 21, 2017
    Assignee: Intel Corporation
    Inventors: Edmond Chalom, Dmitry Rudoy, Noam Levy, Harish Essaky Sankaran, Jarno Nikkanen, Joni-Matti Maatta, German Voronov
  • Publication number: 20170264811
    Abstract: An example sensor for phase detection autofocus includes a number of photodiodes to capture light in a number of wavelengths. The example sensor also further includes a color filter array including a grid of alternating color pass filters corresponding to the number of photodiodes. The example sensor further includes a mask including a number of filters to separate a band of light by blocking the band of light on opposing portions of at least two of the alternating color pass filters.
    Type: Application
    Filed: March 11, 2016
    Publication date: September 14, 2017
    Applicant: Intel Corporation
    Inventors: Mikko Ollila, Jarno Nikkanen
  • Patent number: 9591195
    Abstract: Camera control architecture and methods that distribute control responsibilities across hard real-time and soft real-time parts. The operation of digital camera control algorithms can be made less sensitive to timing fluctuations among the various systems within a device platform that includes a camera module (CM) and/or image signal processing (ISP) pipeline. Real-time dispatch of control parameter values may be offloaded from a controller responsible for generating control parameter values. With relaxed timing requirements, camera control algorithm libraries may be developed independent of lower-level hardware responsible for managing the dispatch of control parameter values to the CM and/or ISP.
    Type: Grant
    Filed: July 10, 2014
    Date of Patent: March 7, 2017
    Assignee: Intel Corporation
    Inventors: Jarno Nikkanen, Liron Ain-Kedem