Patents by Inventor Kim Gronholm
Kim Gronholm has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11575876Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.Type: GrantFiled: February 13, 2017Date of Patent: February 7, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Kim Gronholm, Andrew Robert Baldwin
-
Publication number: 20210185299Abstract: The invention relates to a method for calibrating color components of the sensors of a multi-camera device. The method comprises capturing images by more than one sensor of a multi-camera device (910); creating a pool of images of the captured images (920); extracting a first set of color correction parameters utilizing the pool of images (930); extracting a second set of color correction parameters utilizing the pool of images, wherein the second set of color correction parameters has the smallest errors relative to the first set of color correction parameters (940); and calibrating color components of said more than one sensors of the multi-camera device according to the second set of color correction parameters (950).Type: ApplicationFiled: February 23, 2017Publication date: June 17, 2021Inventors: Adrian Burian, Andrew Baldwin, Kim Gronholm
-
Patent number: 10645369Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.Type: GrantFiled: February 13, 2017Date of Patent: May 5, 2020Assignee: Nokia Technologies OyInventors: Kim Gronholm, Andrew Robert Baldwin
-
Patent number: 10616548Abstract: There are disclosed various methods, apparatuses and computer programs for processing video information. In an embodiment of the method a first video stream representing a left view of a part of a scene and a second video stream representing a right view of the part of the scene are received. Optical enhancement data regarding image pairs of the first video stream and the second video stream and transform data for warping at least one of the left view and the right view are obtained (514). The first video stream and the second video stream are warped (516-522) on the basis of the optical enhancement data and the transform data.Type: GrantFiled: January 20, 2017Date of Patent: April 7, 2020Assignee: Nokia Technologies OyInventors: Marko Niemelä, Kim Gronholm
-
Patent number: 10455221Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.Type: GrantFiled: March 19, 2015Date of Patent: October 22, 2019Assignee: Nokia Technologies OyInventors: Kim Gronholm, Andrew Robert Baldwin
-
Patent number: 10205902Abstract: The invention relates to a structure of a semiconductor chip (100) comprising photosensitive elements (104) for image capturing. The semiconductor chip (100) comprises a set of photosensitive elements (104) for forming electric signals on the basis of electromagnetic radiation received by the photosensitive elements (104); and other electronic circuitry. A surface of the semiconductor chip comprises a first region (102) and a second region (110); and the set of photosensitive elements (104) is located in the first region (102) and the other electronic circuitry is located in the second region (110). The invention also relates to methods, apparatuses, and computer program products.Type: GrantFiled: November 19, 2015Date of Patent: February 12, 2019Assignee: Nokia Technologies OyInventors: Markku Vaara, Kim Gronholm
-
Publication number: 20190037200Abstract: There are disclosed various methods, apparatuses and computer programs for processing video information. In an embodiment of the method a first video stream representing a left view of a part of a scene and a second video stream representing a right view of the part of the scene are received. Optical enhancement data regarding image pairs of the first video stream and the second video stream and transform data for warping at least one of the left view and the right view are obtained (514). The first video stream and the second video stream are warped (516-522) on the basis of the optical enhancement data and the transform data.Type: ApplicationFiled: January 20, 2017Publication date: January 31, 2019Applicant: Nokia Technologies OyInventors: Marko Niemelä, Kim Gronholm
-
Publication number: 20180343431Abstract: A method, apparatus and computer program product are provided to combine images captured by multiple cameras into a composite panoramic image, such as a 360° panorama, in a manner that reduces image defects and other artifacts at or near a seam between images. In some implementations of example embodiments, the overlapping portions of two images are divided into a plurality of seam regions. Upon selection of a seam region, the seam region is further divided into seam segments. In each seam segment, a depth level associated with the segment is used to calculate convergence value that is applied such that different scaling factors may be applied to image elements at different depths within a given image. Based on the applied convergence values and the resulting stitching at the seam region the image quality at the seam area can be efficiently improved.Type: ApplicationFiled: May 24, 2017Publication date: November 29, 2018Inventors: Muninder Veldandi, Prasad Balasubramanian, Basavaraja S. Vandrotti, Kim Gronholm
-
Patent number: 10115227Abstract: The invention relates to methods, apparatuses and computer program products for rendering of digital image and video content. First information of a first graphic object for rendering a second graphic object and second information of the second graphic object for rendering the second graphic object are formed or received. Dependency information between the first and second graphic objects is formed or received, where the dependency information comprises information for rendering the second graphic object depending on overlapping of said first graphic object and the second graphic object in a viewing direction. The second graphic object is rendered by creating second pixel data using the second information of the second graphic object and the first information of the first graphic object, where the rendering of the second graphic object is carried out for such part of the second graphic object that is overlapped by the first graphic object in the viewing direction.Type: GrantFiled: December 3, 2014Date of Patent: October 30, 2018Assignee: Nokia Technologies OyInventors: Marko Niemelä, Kim Gronholm, Andrew Baldwin
-
Publication number: 20170339364Abstract: The invention relates to a structure of a semiconductor chip (100) comprising photosensitive elements (104) for image capturing. The semiconductor chip (100) comprises a set of photosensitive elements (104) for forming electric signals on the basis of electromagnetic radiation received by the photosensitive elements (104); and other electronic circuitry. A surface of the semiconductor chip comprises a first region (102) and a second region (110); and the set of photosensitive elements (104) is located in the first region (102) and the other electronic circuitry is located in the second region (110). The invention also relates to methods, apparatuses, and computer program products.Type: ApplicationFiled: November 19, 2015Publication date: November 23, 2017Inventors: Markku Vaara, Kim Gronholm
-
Publication number: 20170330369Abstract: The invention relates to methods, apparatuses and computer program products for rendering of digital image and video content. First information of a first graphic object for rendering a second graphic object and second information of the second graphic object for rendering the second graphic object are formed or received. Dependency information between the first and second graphic objects is formed or received, where the dependency information comprises information for rendering the second graphic object depending on overlapping of said first graphic object and the second graphic object in a viewing direction. The second graphic object is rendered by creating second pixel data using the second information of the second graphic object and the first information of the first graphic object, where the rendering of the second graphic object is carried out for such part of the second graphic object that is overlapped by the first graphic object in the viewing direction.Type: ApplicationFiled: December 3, 2014Publication date: November 16, 2017Inventors: Marko NIEMELÄ, Kim GRÖNHOLM, Andrew BALDWIN
-
Publication number: 20170280133Abstract: The invention relates to forming a scene model and determining a first group of scene points, the first group of scene points being visible from a rendering viewpoint, determining a second group of scene points, the second group of scene points being at least partially obscured by the first group of scene points viewed from the rendering viewpoint, forming a first render layer using the first group of scene points and a second render layer using the second group of scene points, and providing the first and second render layers for rendering a stereo image.Type: ApplicationFiled: September 9, 2014Publication date: September 28, 2017Inventors: Marko NIEMELÄ, Kim GRÖNHOLM, Andrew BALDWIN
-
Publication number: 20170227841Abstract: The invention relates to a camera device. The camera device has a view direction and comprises a plurality of cameras, at least one central camera and at least two peripheral cameras. Each said camera has a respective field of view, and each said field of view covers the view direction of the camera device. The cameras are positioned with respect to each other such that the central cameras and peripheral cameras form at least two stereo camera pairs with a natural disparity and a stereo field of view, each said stereo field of view covering the view direction of the camera device. The camera device has a central field of view, the central field of view comprising a combined stereo field of view of the stereo camera pairs, and a peripheral field of view comprising fields of view of the cameras at least partly outside the central field of view.Type: ApplicationFiled: October 7, 2014Publication date: August 10, 2017Inventors: Marko NIEMELA, Kim GRONHOLM, Andrew BALDWIN
-
Publication number: 20170163970Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.Type: ApplicationFiled: February 13, 2017Publication date: June 8, 2017Inventors: Kim Gronholm, Andrew Robert Baldwin
-
Publication number: 20170155884Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.Type: ApplicationFiled: February 13, 2017Publication date: June 1, 2017Inventors: Kim Gronholm, Andrew Robert Baldwin
-
Publication number: 20170118458Abstract: The invention relates to creating and viewing stereo images, for example stereo video images, also called 3D video. At least three camera sources with overlapping fields of view are used to capture a scene so that an area of the scene is covered by at least three cameras. At the viewer, a camera pair is chosen from the multiple cameras to create a stereo camera pair that best matches the location of the eyes of the user if they were located at the place of the camera sources. That is, a camera pair is chosen so that the disparity created by the camera sources resembles the disparity that the user's eyes would have at that location. If the user tilts his head, or the view orientation is otherwise altered, a new pair can be formed, for example by switching the other camera. The viewer device then forms the images of the video frames for the left and right eyes by picking the best sources for each area of each image for realistic stereo disparity.Type: ApplicationFiled: March 19, 2015Publication date: April 27, 2017Inventors: Kim GRÖNHOLM, Andrew Robert BALDWIN
-
Patent number: 9595015Abstract: An apparatus comprises at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: enable the creation of a discrete journal comprising time-stamped user event content taken from a plurality of user applications, the discrete journal relating to a discrete journal timeframe and wherein the time-stamped user event content has time-stamps within the discrete journal timeframe.Type: GrantFiled: April 5, 2012Date of Patent: March 14, 2017Assignee: Nokia Technologies OyInventors: Vittorio Bucchieri, Manuela Zavattaro, Kim Gronholm, Matt Turnbull, Nicola Plaisant, Josh Mitchelmore
-
Publication number: 20130268828Abstract: An apparatus comprises at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: enable the creation of a discrete journal comprising time-stamped user event content taken from a plurality of user applications, the discrete journal relating to a discrete journal timeframe and wherein the time-stamped user event content has time-stamps within the discrete journal timeframe.Type: ApplicationFiled: April 5, 2012Publication date: October 10, 2013Applicant: NOKIA CORPORATIONInventors: Vittorio Bucchieri, Manuela Zavattaro, Kim Gronholm, Matt Turnbull, Nicola Plaisant, Josh Mitchelmore