Patents by Inventor Kim Gronholm

Kim Gronholm has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11575876
    Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.
    Type: Grant
    Filed: February 13, 2017
    Date of Patent: February 7, 2023
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Kim Gronholm, Andrew Robert Baldwin
  • Publication number: 20210185299
    Abstract: The invention relates to a method for calibrating color components of the sensors of a multi-camera device. The method comprises capturing images by more than one sensor of a multi-camera device (910); creating a pool of images of the captured images (920); extracting a first set of color correction parameters utilizing the pool of images (930); extracting a second set of color correction parameters utilizing the pool of images, wherein the second set of color correction parameters has the smallest errors relative to the first set of color correction parameters (940); and calibrating color components of said more than one sensors of the multi-camera device according to the second set of color correction parameters (950).
    Type: Application
    Filed: February 23, 2017
    Publication date: June 17, 2021
    Inventors: Adrian Burian, Andrew Baldwin, Kim Gronholm
  • Patent number: 10645369
    Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.
    Type: Grant
    Filed: February 13, 2017
    Date of Patent: May 5, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Kim Gronholm, Andrew Robert Baldwin
  • Patent number: 10616548
    Abstract: There are disclosed various methods, apparatuses and computer programs for processing video information. In an embodiment of the method a first video stream representing a left view of a part of a scene and a second video stream representing a right view of the part of the scene are received. Optical enhancement data regarding image pairs of the first video stream and the second video stream and transform data for warping at least one of the left view and the right view are obtained (514). The first video stream and the second video stream are warped (516-522) on the basis of the optical enhancement data and the transform data.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: April 7, 2020
    Assignee: Nokia Technologies Oy
    Inventors: Marko Niemelä, Kim Gronholm
  • Patent number: 10455221
    Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.
    Type: Grant
    Filed: March 19, 2015
    Date of Patent: October 22, 2019
    Assignee: Nokia Technologies Oy
    Inventors: Kim Gronholm, Andrew Robert Baldwin
  • Patent number: 10205902
    Abstract: The invention relates to a structure of a semiconductor chip (100) comprising photosensitive elements (104) for image capturing. The semiconductor chip (100) comprises a set of photosensitive elements (104) for forming electric signals on the basis of electromagnetic radiation received by the photosensitive elements (104); and other electronic circuitry. A surface of the semiconductor chip comprises a first region (102) and a second region (110); and the set of photosensitive elements (104) is located in the first region (102) and the other electronic circuitry is located in the second region (110). The invention also relates to methods, apparatuses, and computer program products.
    Type: Grant
    Filed: November 19, 2015
    Date of Patent: February 12, 2019
    Assignee: Nokia Technologies Oy
    Inventors: Markku Vaara, Kim Gronholm
  • Publication number: 20190037200
    Abstract: There are disclosed various methods, apparatuses and computer programs for processing video information. In an embodiment of the method a first video stream representing a left view of a part of a scene and a second video stream representing a right view of the part of the scene are received. Optical enhancement data regarding image pairs of the first video stream and the second video stream and transform data for warping at least one of the left view and the right view are obtained (514). The first video stream and the second video stream are warped (516-522) on the basis of the optical enhancement data and the transform data.
    Type: Application
    Filed: January 20, 2017
    Publication date: January 31, 2019
    Applicant: Nokia Technologies Oy
    Inventors: Marko Niemelä, Kim Gronholm
  • Publication number: 20180343431
    Abstract: A method, apparatus and computer program product are provided to combine images captured by multiple cameras into a composite panoramic image, such as a 360° panorama, in a manner that reduces image defects and other artifacts at or near a seam between images. In some implementations of example embodiments, the overlapping portions of two images are divided into a plurality of seam regions. Upon selection of a seam region, the seam region is further divided into seam segments. In each seam segment, a depth level associated with the segment is used to calculate convergence value that is applied such that different scaling factors may be applied to image elements at different depths within a given image. Based on the applied convergence values and the resulting stitching at the seam region the image quality at the seam area can be efficiently improved.
    Type: Application
    Filed: May 24, 2017
    Publication date: November 29, 2018
    Inventors: Muninder Veldandi, Prasad Balasubramanian, Basavaraja S. Vandrotti, Kim Gronholm
  • Patent number: 10115227
    Abstract: The invention relates to methods, apparatuses and computer program products for rendering of digital image and video content. First information of a first graphic object for rendering a second graphic object and second information of the second graphic object for rendering the second graphic object are formed or received. Dependency information between the first and second graphic objects is formed or received, where the dependency information comprises information for rendering the second graphic object depending on overlapping of said first graphic object and the second graphic object in a viewing direction. The second graphic object is rendered by creating second pixel data using the second information of the second graphic object and the first information of the first graphic object, where the rendering of the second graphic object is carried out for such part of the second graphic object that is overlapped by the first graphic object in the viewing direction.
    Type: Grant
    Filed: December 3, 2014
    Date of Patent: October 30, 2018
    Assignee: Nokia Technologies Oy
    Inventors: Marko Niemelä, Kim Gronholm, Andrew Baldwin
  • Publication number: 20170339364
    Abstract: The invention relates to a structure of a semiconductor chip (100) comprising photosensitive elements (104) for image capturing. The semiconductor chip (100) comprises a set of photosensitive elements (104) for forming electric signals on the basis of electromagnetic radiation received by the photosensitive elements (104); and other electronic circuitry. A surface of the semiconductor chip comprises a first region (102) and a second region (110); and the set of photosensitive elements (104) is located in the first region (102) and the other electronic circuitry is located in the second region (110). The invention also relates to methods, apparatuses, and computer program products.
    Type: Application
    Filed: November 19, 2015
    Publication date: November 23, 2017
    Inventors: Markku Vaara, Kim Gronholm
  • Publication number: 20170330369
    Abstract: The invention relates to methods, apparatuses and computer program products for rendering of digital image and video content. First information of a first graphic object for rendering a second graphic object and second information of the second graphic object for rendering the second graphic object are formed or received. Dependency information between the first and second graphic objects is formed or received, where the dependency information comprises information for rendering the second graphic object depending on overlapping of said first graphic object and the second graphic object in a viewing direction. The second graphic object is rendered by creating second pixel data using the second information of the second graphic object and the first information of the first graphic object, where the rendering of the second graphic object is carried out for such part of the second graphic object that is overlapped by the first graphic object in the viewing direction.
    Type: Application
    Filed: December 3, 2014
    Publication date: November 16, 2017
    Inventors: Marko NIEMELÄ, Kim GRÖNHOLM, Andrew BALDWIN
  • Publication number: 20170280133
    Abstract: The invention relates to forming a scene model and determining a first group of scene points, the first group of scene points being visible from a rendering viewpoint, determining a second group of scene points, the second group of scene points being at least partially obscured by the first group of scene points viewed from the rendering viewpoint, forming a first render layer using the first group of scene points and a second render layer using the second group of scene points, and providing the first and second render layers for rendering a stereo image.
    Type: Application
    Filed: September 9, 2014
    Publication date: September 28, 2017
    Inventors: Marko NIEMELÄ, Kim GRÖNHOLM, Andrew BALDWIN
  • Publication number: 20170227841
    Abstract: The invention relates to a camera device. The camera device has a view direction and comprises a plurality of cameras, at least one central camera and at least two peripheral cameras. Each said camera has a respective field of view, and each said field of view covers the view direction of the camera device. The cameras are positioned with respect to each other such that the central cameras and peripheral cameras form at least two stereo camera pairs with a natural disparity and a stereo field of view, each said stereo field of view covering the view direction of the camera device. The camera device has a central field of view, the central field of view comprising a combined stereo field of view of the stereo camera pairs, and a peripheral field of view comprising fields of view of the cameras at least partly outside the central field of view.
    Type: Application
    Filed: October 7, 2014
    Publication date: August 10, 2017
    Inventors: Marko NIEMELA, Kim GRONHOLM, Andrew BALDWIN
  • Publication number: 20170163970
    Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.
    Type: Application
    Filed: February 13, 2017
    Publication date: June 8, 2017
    Inventors: Kim Gronholm, Andrew Robert Baldwin
  • Publication number: 20170155884
    Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.
    Type: Application
    Filed: February 13, 2017
    Publication date: June 1, 2017
    Inventors: Kim Gronholm, Andrew Robert Baldwin
  • Publication number: 20170118458
    Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.
    Type: Application
    Filed: March 19, 2015
    Publication date: April 27, 2017
    Inventors: Kim GRÖNHOLM, Andrew Robert BALDWIN
  • Patent number: 9595015
    Abstract: An apparatus comprises at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: enable the creation of a discrete journal comprising time-stamped user event content taken from a plurality of user applications, the discrete journal relating to a discrete journal timeframe and wherein the time-stamped user event content has time-stamps within the discrete journal timeframe.
    Type: Grant
    Filed: April 5, 2012
    Date of Patent: March 14, 2017
    Assignee: Nokia Technologies Oy
    Inventors: Vittorio Bucchieri, Manuela Zavattaro, Kim Gronholm, Matt Turnbull, Nicola Plaisant, Josh Mitchelmore
  • Publication number: 20130268828
    Abstract: An apparatus comprises at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: enable the creation of a discrete journal comprising time-stamped user event content taken from a plurality of user applications, the discrete journal relating to a discrete journal timeframe and wherein the time-stamped user event content has time-stamps within the discrete journal timeframe.
    Type: Application
    Filed: April 5, 2012
    Publication date: October 10, 2013
    Applicant: NOKIA CORPORATION
    Inventors: Vittorio Bucchieri, Manuela Zavattaro, Kim Gronholm, Matt Turnbull, Nicola Plaisant, Josh Mitchelmore