Patents by Inventor Kimmo Roimela

Kimmo Roimela has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240135644
    Abstract: A method including: receiving colour images, depth images, and viewpoint information; dividing 3D space occupied by real-world environment into 3D grid(s) of voxels (204); creating 3D data structure(s) comprising nodes, each node representing corresponding voxel; dividing colour image and depth image into colour tiles and depth tiles, respectively; mapping colour tile to voxel(s) whose colour information is captured in colour tile, based on depth information captured in corresponding depth tile and viewpoint from which colour image and depth image are captured; and storing, in node representing voxel(s), reference information indicative of unique identification of colour tile that captures colour information of voxel(s) and corresponding depth tile that captures depth information, along with viewpoint information indicative of viewpoint from which colour image and depth image are captured.
    Type: Application
    Filed: October 23, 2022
    Publication date: April 25, 2024
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Kimmo Roimela, Pekka Väänänen
  • Publication number: 20240046556
    Abstract: A computer-implemented method including: receiving visible-light images captured from viewpoints using visible-light camera(s); creating 3D model of real-world environment, wherein 3D model stores colour information pertaining to 3D points on surfaces of real objects (204); dividing 3D points into groups of 3D points, based on at least one of: whether surface normal of 3D points in group lie within predefined threshold angle from each other, differences in materials of real objects, differences in textures of surfaces of real objects; for group of 3D points, determining at least two of visible-light images in which group of 3D points is captured from different viewpoints, wherein said images are representative of different surface irradiances of group of 3D points; and storing, in 3D model, information indicative of different surface irradiances.
    Type: Application
    Filed: August 4, 2022
    Publication date: February 8, 2024
    Applicant: Varjo Technologies Oy
    Inventors: Mikko Strandborg, Kimmo Roimela
  • Patent number: 11823421
    Abstract: A method, apparatus, and computer program product provide for compression of volumetric video in a manner that is more efficient and requires less metadata updates. A method can include converting a volumetric video scene into a canonical representation comprising a plurality of frames comprising a video atlas and corresponding metadata. Each frame can be divided into a plurality of tiles based on different tile characteristics, which can be used to analyze and characterize the different tiles for atlas packing purposes. Tiles can be clipped or merged or otherwise edited in the atlas. Tiles can be decomposed to metadata suitable for later rendering of the tile. Tiles having a similar enough color attribute or depth attribute during the entire group of photos can be rendered as a single instance, clipped entirely, and rendered based upon a reference tile and the stored metadata.
    Type: Grant
    Filed: March 11, 2020
    Date of Patent: November 21, 2023
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Lauri Iiola, Kimmo Roimela, Vinod Kumar Malamal Vadakital, Jaakko Keränen, Mika Pesonen
  • Patent number: 11711535
    Abstract: Apparatuses, methods, and computer programs are disclosed to implement video-based cloud compression model to world signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide first signaling information comprising information related to a world domain, wherein the world domain is a point cloud frame that is represented by a number of points in a first volumetric coordinate system; and provide second signaling information comprising information related to a conversion of a model domain to the world domain, wherein the model domain represents the point cloud frame by a number of points in a second volumetric coordinate system.
    Type: Grant
    Filed: September 16, 2020
    Date of Patent: July 25, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Sebastian Schwarz, Lukasz Kondrad, Kimmo Roimela, Lauri Ilola
  • Patent number: 11653024
    Abstract: The various embodiments of the invention relates to a method and a technical equipment for video compression. The method comprises processing volumetric image data comprising a plurality of points; defining a hemisphere (601) around a surface (602) normal at each point in the volumetric image; partitioning each of the defined hemispheres spatially into a predefined number of angles (603); determining a representative radiance value for each angle of the predefined number of angles (603) of a defined hemisphere (601); generating a matrix (610) for a point storing the determined representative radiance values; and encoding the generated matrix (610) for the point for video compression.
    Type: Grant
    Filed: May 7, 2018
    Date of Patent: May 16, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Vinod Kumar Malamal Vadakital, Kimmo Roimela, Johannes Pystynen
  • Publication number: 20230129875
    Abstract: The embodiments relate to a method comprising receiving as an input a volumetric video frame comprising volumetric video data (910); decomposing the volumetric video frame into one or more patches, wherein a patch comprises a volumetric video data component (920); packing several patches, where at least two patches of the several patches comprise a different volumetric video data component with respect to each other, into one video frame (930); generating a bitstream comprising an encoded video frame (940); signaling, in or along the bitstream, existence of encoded video frame containing patches of more than one different volumetric video data component (950); and transmitting the encoded bitstream to a storage for rendering (960). The embodiments also relate to a technical equipment for implementing the method.
    Type: Application
    Filed: March 5, 2021
    Publication date: April 27, 2023
    Inventors: Lukasz KONDRAD, Vinod Kumar MALAMAL VADAKITAL, Kimmo ROIMELA, Lauri ILOLA, Sebastian SCHWARZ
  • Publication number: 20230068178
    Abstract: A method and technical equipment for encoding, where the method comprises at least receiving a video presentation frame, where the video presentation represents a three-dimensional data in the form of mesh data (810); separating from the mesh data information on vertices, wherein the information comprises at least connectivity data defining connections between vertices (820); determining parameters relating to said connectivity data (830); encoding the parameters to a first bitstream as a video component (840); and storing the encoded first bitstream for transmission to a rendering apparatus (850). In addition to encoding, also decoding is disclosed.
    Type: Application
    Filed: December 7, 2020
    Publication date: March 2, 2023
    Inventors: Sebastian SCHWARZ, Kimmo ROIMELA, Lauri ILOLA, Lukasz KONDRAD
  • Patent number: 11587202
    Abstract: A method comprising: processing a recording of a scene to recognise a predetermined user command event performed within the scene; and automatically controlling image processing of a captured image of the scene to adapt the captured image, in dependence on said recognition of the predetermined user command event performed within the scene.
    Type: Grant
    Filed: December 15, 2016
    Date of Patent: February 21, 2023
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Antti Eronen, Jussi Leppänen, Arto Lehtiniemi, Kimmo Roimela
  • Publication number: 20230050860
    Abstract: A method comprising: providing a 3D representation of at least one object as an input for an encoder (500); projecting the 3D representation onto at least one 2D patch (502); generating at least a geometry image and a texture image from the 2D patch (504); generating, based on the geometry image, a mesh comprising a number of vertices (506); mapping the number of vertices to two- dimensional (2D) coordinates of the texture image (508); and signalling said 2D coordinates of the texture image to be applied to the number of vertices of the mesh in or along a bitstream (510).
    Type: Application
    Filed: December 7, 2020
    Publication date: February 16, 2023
    Inventors: Lauri ILOLA, Vinod Kumar MALAMAL VADAKITAL, Sebastian SCHWARZ, Kimmo ROIMELA, Lukasz KONDRAD
  • Patent number: 11528469
    Abstract: There are disclosed various methods, apparatuses and computer program products for viewing volume signalling of volumetric video. In accordance with an embodiment of a method information of a viewing volume appropriate for viewing a volumetric video is obtained. The viewing volume is examined to determine what geometrical shapes describe the viewing volume. One or more geometrical shapes determined for describing the viewing volume are selected, wherein signalling information for the selected one or more geometrical shapes is constructed.
    Type: Grant
    Filed: August 13, 2019
    Date of Patent: December 13, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Vinod Kumar Malamal Vadakital, Kimmo Roimela, Johannes Pystynen
  • Patent number: 11514665
    Abstract: Images of optical codes are mapped to an overview image to localize optical codes within a space. By localizing optical codes, information about locations of various products can be ascertained. One or more techniques can be used to map the images of optical codes to the overview image. The overview image can be a composite image formed by stitching together several images.
    Type: Grant
    Filed: April 29, 2021
    Date of Patent: November 29, 2022
    Assignee: SCANDIT AG
    Inventors: Fabian Nater, Kimmo Roimela, Bernd Schoner, Matthias Bloch, Christian Floerkemeier
  • Patent number: 11430178
    Abstract: A method and system for three-dimensional video content processing is disclosed comprising an operation of receiving first video data representing three-dimensional video content arranged as a plurality of first tiles associated with respective sub-areas of an image. Another operation comprises providing data indicating for each first tile a depth range of video content within said tile. Another operation comprises determining for each first tile a respective volume based on the depth range. Another operation comprises determining a field of view of a user in relation to the first tile volumes. Another operation comprises rendering of the first video data for one or more first tiles only if their determined volume is at least partially within the field of view.
    Type: Grant
    Filed: June 11, 2018
    Date of Patent: August 30, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Johannes Pystynen, Kimmo Roimela, Mika Pesonen, Johannes Rajala
  • Publication number: 20220217400
    Abstract: A method for decoding comprises receiving a compressed bitstream relating to a video presentation; decoding from the received bitstream data relating to three-dimensional blocks of a video frame; for each block of the video frame, determining information on surface parameters; generating a bounding box for a three-dimensional block according to the surface parameters; calculating a ray direction for each pixel of the three-dimensional block from a viewpoint to coordinates of the pixel; determining at least two points according to an intersection of the ray to the generated bounding box; ray casting points between the determined at least two points until a condition to finish the ray casting is met; reconstructing three-dimensional data from the geometry image and the texture image according to the information on one or more surface parameters for a block; reconstructing a video presentation according to the reconstructed three-dimensional data for rendering.
    Type: Application
    Filed: April 15, 2020
    Publication date: July 7, 2022
    Inventors: Sebastian SCHWARZ, Kimmo ROIMELA, Mika PESONEN
  • Patent number: 11259050
    Abstract: Apparatuses, methods, and computer programs are disclosed to implement six degrees of freedom spatial layout signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: segment a scene of volumetric video into one or more sequences, each sequence comprising one or more sub viewing volumes having one or more bitstream alternatives; generate viewing volume and view point indications within one or more dynamic adaptive streaming over hypertext transfer protocol media presentation description files; generate one or more sub volume scheme uniform resource identifiers for client side instructions to retrieve content; and provide one or more of the sub viewing volumes based on a client selection and request.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: February 22, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Lauri Ilola, Kimmo Roimela, Vinod Kumar Malamal Vadakital, Jaakko Keranen
  • Patent number: 11218683
    Abstract: The invention relates to a method and technical equipment for implementing the method. The method comprises generating a three-dimensional segment of a scene of a content; generating more than one two-dimensional views of the three-dimensional segment, each two-dimensional view representing a virtual camera view; generating multi-view streams by encoding each of the two-dimensional views; encoding parameters of a virtual camera to the respective stream of the multi-view stream; receiving a selection of one or more streams of the multi-view stream; and streaming only the selected one or more streams.
    Type: Grant
    Filed: March 20, 2018
    Date of Patent: January 4, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Mika Pesonen, Kimmo Roimela, Johannes Pystynen, Ville Timonen, Johannes Rajala, Emre Aksu
  • Publication number: 20210321083
    Abstract: There are disclosed various methods, apparatuses and computer program products for viewing volume signalling of volumetric video. In accordance with an embodiment of a method information of a viewing volume appropriate for viewing a volumetric video is obtained. The viewing volume is examined to determine what geometrical shapes describe the viewing volume. One or more geometrical shapes determined for describing the viewing volume are selected, wherein signalling information for the selected one or more geometrical shapes is constructed.
    Type: Application
    Filed: August 13, 2019
    Publication date: October 14, 2021
    Inventors: Vinod Kumar Malamal Vadakital, Kimmo Roimela, Johannes Pystynen
  • Publication number: 20210312217
    Abstract: Images of optical codes are mapped to an overview image to localize optical codes within a space. By localizing optical codes, information about locations of various products can be ascertained. One or more techniques can be used to map the images of optical codes to the overview image. The overview image can be a composite image formed by stitching together several images.
    Type: Application
    Filed: April 29, 2021
    Publication date: October 7, 2021
    Applicant: SCANDIT AG
    Inventors: Fabian Nater, Kimmo Roimela, Bernd Schoner, Matthias Bloch, Christian Floerkemeier
  • Publication number: 20210235117
    Abstract: The various embodiments of the invention relates to a method and a technical equipment for video compression. The method comprises processing volumetric image data comprising a plurality of points; defining a hemisphere (601) around a surface (602) normal at each point in the volumetric image; partitioning each of the defined hemispheres spatially into a predefined number of angles (603); determining a representative radiance value for each angle of the predefined number of angles (603) of a defined hemisphere (601); generating a matrix (610) for a point storing the determined representative radiance values; and encoding the generated matrix (610) for the point for video compression.
    Type: Application
    Filed: May 7, 2018
    Publication date: July 29, 2021
    Inventors: Vinod Kumar Malamal Vadakital, Kimmo Roimela, Johannes Pystynen
  • Publication number: 20210125399
    Abstract: A method and system for three-dimensional video content processing is disclosed comprising an operation of receiving first video data representing three-dimensional video content arranged as a plurality of first tiles associated with respective sub-areas of an image. Another operation comprises providing data indicating for each first tile a depth range of video content within said tile. Another operation comprises determining for each first tile a respective volume based on the depth range. Another operation comprises determining a field of view of a user in relation to the first tile volumes. Another operation comprises rendering of the first video data for one or more first tiles only if their determined volume is at least partially within the field of view.
    Type: Application
    Filed: June 11, 2018
    Publication date: April 29, 2021
    Inventors: Johannes Pystynen, Kimmo Roimela, Mika Pesonen, Johannes Rajala
  • Publication number: 20210092444
    Abstract: Apparatuses, methods, and computer programs are disclosed to implement six degrees of freedom spatial layout signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: segment a scene of volumetric video into one or more sequences, each sequence comprising one or more sub viewing volumes having one or more bitstream alternatives; generate viewing volume and view point indications within one or more dynamic adaptive streaming over hypertext transfer protocol media presentation description files; generate one or more sub volume scheme uniform resource identifiers for client side instructions to retrieve content; and provide one or more of the sub viewing volumes based on a client selection and request.
    Type: Application
    Filed: September 14, 2020
    Publication date: March 25, 2021
    Inventors: Lauri ILOLA, Kimmo ROIMELA, Vinod Kumar Malamal VADAKITAL, Jaakko KERANEN