Patents by Inventor Lauri Ilola

Lauri Ilola has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11711535
    Abstract: Apparatuses, methods, and computer programs are disclosed to implement video-based cloud compression model to world signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide first signaling information comprising information related to a world domain, wherein the world domain is a point cloud frame that is represented by a number of points in a first volumetric coordinate system; and provide second signaling information comprising information related to a conversion of a model domain to the world domain, wherein the model domain represents the point cloud frame by a number of points in a second volumetric coordinate system.
    Type: Grant
    Filed: September 16, 2020
    Date of Patent: July 25, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Sebastian Schwarz, Lukasz Kondrad, Kimmo Roimela, Lauri Ilola
  • Patent number: 11695932
    Abstract: An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: provide an animation timing extension; wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata; wherein the metadata track of the timed metadata is listed with an object associated with moving picture media; and align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation; wherein a sample of the metadata track is used to manipulate an animation event.
    Type: Grant
    Filed: September 21, 2021
    Date of Patent: July 4, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Lukasz Kondrad, Lauri Ilola
  • Publication number: 20230129875
    Abstract: The embodiments relate to a method comprising receiving as an input a volumetric video frame comprising volumetric video data (910); decomposing the volumetric video frame into one or more patches, wherein a patch comprises a volumetric video data component (920); packing several patches, where at least two patches of the several patches comprise a different volumetric video data component with respect to each other, into one video frame (930); generating a bitstream comprising an encoded video frame (940); signaling, in or along the bitstream, existence of encoded video frame containing patches of more than one different volumetric video data component (950); and transmitting the encoded bitstream to a storage for rendering (960). The embodiments also relate to a technical equipment for implementing the method.
    Type: Application
    Filed: March 5, 2021
    Publication date: April 27, 2023
    Inventors: Lukasz KONDRAD, Vinod Kumar MALAMAL VADAKITAL, Kimmo ROIMELA, Lauri ILOLA, Sebastian SCHWARZ
  • Publication number: 20230068178
    Abstract: A method and technical equipment for encoding, where the method comprises at least receiving a video presentation frame, where the video presentation represents a three-dimensional data in the form of mesh data (810); separating from the mesh data information on vertices, wherein the information comprises at least connectivity data defining connections between vertices (820); determining parameters relating to said connectivity data (830); encoding the parameters to a first bitstream as a video component (840); and storing the encoded first bitstream for transmission to a rendering apparatus (850). In addition to encoding, also decoding is disclosed.
    Type: Application
    Filed: December 7, 2020
    Publication date: March 2, 2023
    Inventors: Sebastian SCHWARZ, Kimmo ROIMELA, Lauri ILOLA, Lukasz KONDRAD
  • Publication number: 20230059516
    Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments the method for video encoding comprises obtaining compressed volumetric video data representing a three-dimensional scene or object (71); capsulating the compressed volumetric video data into a data structure (72); obtaining data of a two-dimensional projection of at least a part of the three-dimensional scene as seen from a certain viewport (73); and including the data of the two-dimensional projection into the data structure (74).
    Type: Application
    Filed: December 7, 2020
    Publication date: February 23, 2023
    Inventors: Sebastian SCHWARZ, Lukasz KONDRAD, Miska HANNUKSELA, Emre Baris AKSU, Lauri ILOLA
  • Publication number: 20230050860
    Abstract: A method comprising: providing a 3D representation of at least one object as an input for an encoder (500); projecting the 3D representation onto at least one 2D patch (502); generating at least a geometry image and a texture image from the 2D patch (504); generating, based on the geometry image, a mesh comprising a number of vertices (506); mapping the number of vertices to two- dimensional (2D) coordinates of the texture image (508); and signalling said 2D coordinates of the texture image to be applied to the number of vertices of the mesh in or along a bitstream (510).
    Type: Application
    Filed: December 7, 2020
    Publication date: February 16, 2023
    Inventors: Lauri ILOLA, Vinod Kumar MALAMAL VADAKITAL, Sebastian SCHWARZ, Kimmo ROIMELA, Lukasz KONDRAD
  • Patent number: 11581022
    Abstract: A method, apparatus and computer program product are provided to signal and store compressed point clouds in video encoding. The method, apparatus and computer program product may be utilized in conjunction with a variety of video formats. Relative to encoding of compressed point clouds, the method, apparatus and computer program product access a point cloud compression coded bitstream and cause storage of the point cloud compression coded bitstream. The point cloud compression coded bitstream comprises a texture information bitstream, a geometry information bitstream, and an auxiliary metadata bitstream. Relative to the decoding of compressed point clouds, the method, apparatus and computer program product receive a point cloud compression coded bitstream and decode the point cloud compression coded bitstream.
    Type: Grant
    Filed: May 19, 2020
    Date of Patent: February 14, 2023
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Lauri Ilola, Emre Baris Aksu, Miska Matias Hannuksela, Sebastian Schwarz
  • Patent number: 11412267
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide signal information to identify an atlas identifier on a sample of a volumetric media track, or on the volumetric media track in a multi-track container; wherein the signal information allows a file parser to link volumetric media tracks with different atlas identifiers that originate from a volumetric media elementary stream; and wherein the file parser is able to reconstruct the volumetric media elementary stream based on the signal information and data encapsulated in the multi-track container.
    Type: Grant
    Filed: January 4, 2021
    Date of Patent: August 9, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Sebastian Schwarz, Lukasz Kondrad, Emre Aksu, Lauri Ilola, Vinod Kumar Malamal Vadakital, Miska Matias Hannuksela
  • Patent number: 11403804
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: receive a scene description comprising data associated with a scene; place the data associated with the scene into data buffers and create command buffers; adapt the data placed within the data buffers and synchronize the data within the data buffers with information provided from local media or network media; signal information about the adaptation to update the command buffers that command a renderer; and render the scene using the data within the data buffers and the command buffers.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: August 2, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Lauri Ilola, Lukasz Kondrad, Emre Aksu, Miska Matias Hannuksela, Sebastian Schwarz
  • Patent number: 11315289
    Abstract: Apparatuses, methods, and computer programs are disclosed. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: signal a depth start of a patch data unit of a patch of data content based on an identifier of a tile and a patch index; wherein the depth start is used to derive a range of at least one depth value for the patch based on the patch index in a tile having the identifier; and signal a depth threshold of an immersive video extension of the patch data unit; wherein the depth threshold specifies a threshold below which an occupancy value is defined to be unoccupied for the patch based on the patch index.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: April 26, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Kimmo Tapio Roimela, Vinod Kumar Malamal Vadakital, Lauri Ilola
  • Publication number: 20220094941
    Abstract: An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: provide an animation timing extension; wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata; wherein the metadata track of the timed metadata is listed with an object associated with moving picture media; and align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation; wherein a sample of the metadata track is used to manipulate an animation event.
    Type: Application
    Filed: September 21, 2021
    Publication date: March 24, 2022
    Inventors: Lukasz KONDRAD, Lauri ILOLA
  • Patent number: 11259050
    Abstract: Apparatuses, methods, and computer programs are disclosed to implement six degrees of freedom spatial layout signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: segment a scene of volumetric video into one or more sequences, each sequence comprising one or more sub viewing volumes having one or more bitstream alternatives; generate viewing volume and view point indications within one or more dynamic adaptive streaming over hypertext transfer protocol media presentation description files; generate one or more sub volume scheme uniform resource identifiers for client side instructions to retrieve content; and provide one or more of the sub viewing volumes based on a client selection and request.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: February 22, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Lauri Ilola, Kimmo Roimela, Vinod Kumar Malamal Vadakital, Jaakko Keranen
  • Patent number: 11240532
    Abstract: An apparatus includes circuitry configured to: receive information to cull one or more sets of components belonging to the same atlas from at least one volumetric video bitstream; wherein the information comprises one or more of: atlas-to-view mapping metadata indicating an association between patches in at least one atlas and at least one view; atlas-to-object mapping metadata indicating an association between at least one object and the at least one atlas; patch atlas metadata within a metadata for immersive video master atlas to indicate sub-bitstream culling based on fine-grained patch visibility culling; or partial access metadata, wherein leveraging the partial access metadata comprises storing each of the at least one atlas in its own track, and providing sample grouping information to indicate culling on a file format level; and cull the one or more sets of components from the at least one volumetric video bitstream, based on the information.
    Type: Grant
    Filed: March 1, 2021
    Date of Patent: February 1, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Kimmo Tapio Roimela, Lauri Ilola, Vinod Kumar Malamal Vadakital, Lukasz Kondrad
  • Publication number: 20210383590
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: provide patch metadata to signal view-dependent transformations of a texture layer of volumetric data; provide the patch metadata to comprise at least one of: a depth offset of the texture layer with respect to a geometry surface, or texture transformation parameters; and wherein the patch metadata enables a renderer to offset texture coordinates of the texture layer based on a viewing position.
    Type: Application
    Filed: May 26, 2021
    Publication date: December 9, 2021
    Inventors: Kimmo Tapio Roimela, Vinod Kumar Malamal Vadakital, Lauri Ilola, Lukasz Kondrad, Jaakko Keranen
  • Publication number: 20210281879
    Abstract: An apparatus includes circuitry configured to: receive information to cull one or more sets of components belonging to the same atlas from at least one volumetric video bitstream; wherein the information comprises one or more of: atlas-to-view mapping metadata indicating an association between patches in at least one atlas and at least one view; atlas-to-object mapping metadata indicating an association between at least one object and the at least one atlas; patch atlas metadata within a metadata for immersive video master atlas to indicate sub-bitstream culling based on fine-grained patch visibility culling; or partial access metadata, wherein leveraging the partial access metadata comprises storing each of the at least one atlas in its own track, and providing sample grouping information to indicate culling on a file format level; and cull the one or more sets of components from the at least one volumetric video bitstream, based on the information.
    Type: Application
    Filed: March 1, 2021
    Publication date: September 9, 2021
    Inventors: Kimmo Tapio ROIMELA, Lauri Ilola, Vinod Kumar Malamal Vadakital, Lukasz Kondrad
  • Publication number: 20210218999
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide signal information to identify an atlas identifier on a sample of a volumetric media track, or on the volumetric media track in a multi-track container; wherein the signal information allows a file parser to link volumetric media tracks with different atlas identifiers that originate from a volumetric media elementary stream; and wherein the file parser is able to reconstruct the volumetric media elementary stream based on the signal information and data encapsulated in the multi-track container.
    Type: Application
    Filed: January 4, 2021
    Publication date: July 15, 2021
    Inventors: Sebastian SCHWARZ, Lukasz KONDRAD, Emre AKSU, Lauri ILOLA, Vinod Kumar MALAMAL VADAKITAL, Miska Matias HANNUKSELA
  • Publication number: 20210209829
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: receive a scene description comprising data associated with a scene; place the data associated with the scene into data buffers and create command buffers; adapt the data placed within the data buffers and synchronize the data within the data buffers with information provided from local media or network media; signal information about the adaptation to update the command buffers that command a renderer; and render the scene using the data within the data buffers and the command buffers.
    Type: Application
    Filed: December 28, 2020
    Publication date: July 8, 2021
    Inventors: Lauri Ilola, Lukasz Kondrad, Emre Aksu, Miska Matias Hannuksela, Sebastian Schwarz
  • Publication number: 20210097724
    Abstract: Apparatuses, methods, and computer programs are disclosed. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: signal a depth start of a patch data unit of a patch of data content based on an identifier of a tile and a patch index; wherein the depth start is used to derive a range of at least one depth value for the patch based on the patch index in a tile having the identifier; and signal a depth threshold of an immersive video extension of the patch data unit; wherein the depth threshold specifies a threshold below which an occupancy value is defined to be unoccupied for the patch based on the patch index.
    Type: Application
    Filed: September 29, 2020
    Publication date: April 1, 2021
    Inventors: Kimmo Tapio Roimela, Vinod Kumar Malamal Vadakital, Lauri Ilola
  • Publication number: 20210092444
    Abstract: Apparatuses, methods, and computer programs are disclosed to implement six degrees of freedom spatial layout signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: segment a scene of volumetric video into one or more sequences, each sequence comprising one or more sub viewing volumes having one or more bitstream alternatives; generate viewing volume and view point indications within one or more dynamic adaptive streaming over hypertext transfer protocol media presentation description files; generate one or more sub volume scheme uniform resource identifiers for client side instructions to retrieve content; and provide one or more of the sub viewing volumes based on a client selection and request.
    Type: Application
    Filed: September 14, 2020
    Publication date: March 25, 2021
    Inventors: Lauri ILOLA, Kimmo ROIMELA, Vinod Kumar Malamal VADAKITAL, Jaakko KERANEN
  • Publication number: 20210092430
    Abstract: Apparatuses, methods, and computer programs are disclosed to implement video-based cloud compression model to world signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide first signaling information comprising information related to a world domain, wherein the world domain is a point cloud frame that is represented by a number of points in a first volumetric coordinate system; and provide second signaling information comprising information related to a conversion of a model domain to the world domain, wherein the model domain represents the point cloud frame by a number of points in a second volumetric coordinate system.
    Type: Application
    Filed: September 16, 2020
    Publication date: March 25, 2021
    Inventors: Sebastian Schwarz, Lukasz KONDRAD, Kimmo ROIMELA, Lauri ILOLA