Patents by Inventor Lauri Ilola
Lauri Ilola has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11711535Abstract: Apparatuses, methods, and computer programs are disclosed to implement video-based cloud compression model to world signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide first signaling information comprising information related to a world domain, wherein the world domain is a point cloud frame that is represented by a number of points in a first volumetric coordinate system; and provide second signaling information comprising information related to a conversion of a model domain to the world domain, wherein the model domain represents the point cloud frame by a number of points in a second volumetric coordinate system.Type: GrantFiled: September 16, 2020Date of Patent: July 25, 2023Assignee: Nokia Technologies OyInventors: Sebastian Schwarz, Lukasz Kondrad, Kimmo Roimela, Lauri Ilola
-
Patent number: 11695932Abstract: An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: provide an animation timing extension; wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata; wherein the metadata track of the timed metadata is listed with an object associated with moving picture media; and align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation; wherein a sample of the metadata track is used to manipulate an animation event.Type: GrantFiled: September 21, 2021Date of Patent: July 4, 2023Assignee: Nokia Technologies OyInventors: Lukasz Kondrad, Lauri Ilola
-
Publication number: 20230129875Abstract: The embodiments relate to a method comprising receiving as an input a volumetric video frame comprising volumetric video data (910); decomposing the volumetric video frame into one or more patches, wherein a patch comprises a volumetric video data component (920); packing several patches, where at least two patches of the several patches comprise a different volumetric video data component with respect to each other, into one video frame (930); generating a bitstream comprising an encoded video frame (940); signaling, in or along the bitstream, existence of encoded video frame containing patches of more than one different volumetric video data component (950); and transmitting the encoded bitstream to a storage for rendering (960). The embodiments also relate to a technical equipment for implementing the method.Type: ApplicationFiled: March 5, 2021Publication date: April 27, 2023Inventors: Lukasz KONDRAD, Vinod Kumar MALAMAL VADAKITAL, Kimmo ROIMELA, Lauri ILOLA, Sebastian SCHWARZ
-
Publication number: 20230068178Abstract: A method and technical equipment for encoding, where the method comprises at least receiving a video presentation frame, where the video presentation represents a three-dimensional data in the form of mesh data (810); separating from the mesh data information on vertices, wherein the information comprises at least connectivity data defining connections between vertices (820); determining parameters relating to said connectivity data (830); encoding the parameters to a first bitstream as a video component (840); and storing the encoded first bitstream for transmission to a rendering apparatus (850). In addition to encoding, also decoding is disclosed.Type: ApplicationFiled: December 7, 2020Publication date: March 2, 2023Inventors: Sebastian SCHWARZ, Kimmo ROIMELA, Lauri ILOLA, Lukasz KONDRAD
-
Publication number: 20230059516Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments the method for video encoding comprises obtaining compressed volumetric video data representing a three-dimensional scene or object (71); capsulating the compressed volumetric video data into a data structure (72); obtaining data of a two-dimensional projection of at least a part of the three-dimensional scene as seen from a certain viewport (73); and including the data of the two-dimensional projection into the data structure (74).Type: ApplicationFiled: December 7, 2020Publication date: February 23, 2023Inventors: Sebastian SCHWARZ, Lukasz KONDRAD, Miska HANNUKSELA, Emre Baris AKSU, Lauri ILOLA
-
Publication number: 20230050860Abstract: A method comprising: providing a 3D representation of at least one object as an input for an encoder (500); projecting the 3D representation onto at least one 2D patch (502); generating at least a geometry image and a texture image from the 2D patch (504); generating, based on the geometry image, a mesh comprising a number of vertices (506); mapping the number of vertices to two- dimensional (2D) coordinates of the texture image (508); and signalling said 2D coordinates of the texture image to be applied to the number of vertices of the mesh in or along a bitstream (510).Type: ApplicationFiled: December 7, 2020Publication date: February 16, 2023Inventors: Lauri ILOLA, Vinod Kumar MALAMAL VADAKITAL, Sebastian SCHWARZ, Kimmo ROIMELA, Lukasz KONDRAD
-
Patent number: 11581022Abstract: A method, apparatus and computer program product are provided to signal and store compressed point clouds in video encoding. The method, apparatus and computer program product may be utilized in conjunction with a variety of video formats. Relative to encoding of compressed point clouds, the method, apparatus and computer program product access a point cloud compression coded bitstream and cause storage of the point cloud compression coded bitstream. The point cloud compression coded bitstream comprises a texture information bitstream, a geometry information bitstream, and an auxiliary metadata bitstream. Relative to the decoding of compressed point clouds, the method, apparatus and computer program product receive a point cloud compression coded bitstream and decode the point cloud compression coded bitstream.Type: GrantFiled: May 19, 2020Date of Patent: February 14, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Lauri Ilola, Emre Baris Aksu, Miska Matias Hannuksela, Sebastian Schwarz
-
Patent number: 11412267Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide signal information to identify an atlas identifier on a sample of a volumetric media track, or on the volumetric media track in a multi-track container; wherein the signal information allows a file parser to link volumetric media tracks with different atlas identifiers that originate from a volumetric media elementary stream; and wherein the file parser is able to reconstruct the volumetric media elementary stream based on the signal information and data encapsulated in the multi-track container.Type: GrantFiled: January 4, 2021Date of Patent: August 9, 2022Assignee: Nokia Technologies OyInventors: Sebastian Schwarz, Lukasz Kondrad, Emre Aksu, Lauri Ilola, Vinod Kumar Malamal Vadakital, Miska Matias Hannuksela
-
Patent number: 11403804Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: receive a scene description comprising data associated with a scene; place the data associated with the scene into data buffers and create command buffers; adapt the data placed within the data buffers and synchronize the data within the data buffers with information provided from local media or network media; signal information about the adaptation to update the command buffers that command a renderer; and render the scene using the data within the data buffers and the command buffers.Type: GrantFiled: December 28, 2020Date of Patent: August 2, 2022Assignee: Nokia Technologies OyInventors: Lauri Ilola, Lukasz Kondrad, Emre Aksu, Miska Matias Hannuksela, Sebastian Schwarz
-
Patent number: 11315289Abstract: Apparatuses, methods, and computer programs are disclosed. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: signal a depth start of a patch data unit of a patch of data content based on an identifier of a tile and a patch index; wherein the depth start is used to derive a range of at least one depth value for the patch based on the patch index in a tile having the identifier; and signal a depth threshold of an immersive video extension of the patch data unit; wherein the depth threshold specifies a threshold below which an occupancy value is defined to be unoccupied for the patch based on the patch index.Type: GrantFiled: September 29, 2020Date of Patent: April 26, 2022Assignee: Nokia Technologies OyInventors: Kimmo Tapio Roimela, Vinod Kumar Malamal Vadakital, Lauri Ilola
-
Publication number: 20220094941Abstract: An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: provide an animation timing extension; wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata; wherein the metadata track of the timed metadata is listed with an object associated with moving picture media; and align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation; wherein a sample of the metadata track is used to manipulate an animation event.Type: ApplicationFiled: September 21, 2021Publication date: March 24, 2022Inventors: Lukasz KONDRAD, Lauri ILOLA
-
Patent number: 11259050Abstract: Apparatuses, methods, and computer programs are disclosed to implement six degrees of freedom spatial layout signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: segment a scene of volumetric video into one or more sequences, each sequence comprising one or more sub viewing volumes having one or more bitstream alternatives; generate viewing volume and view point indications within one or more dynamic adaptive streaming over hypertext transfer protocol media presentation description files; generate one or more sub volume scheme uniform resource identifiers for client side instructions to retrieve content; and provide one or more of the sub viewing volumes based on a client selection and request.Type: GrantFiled: September 14, 2020Date of Patent: February 22, 2022Assignee: Nokia Technologies OyInventors: Lauri Ilola, Kimmo Roimela, Vinod Kumar Malamal Vadakital, Jaakko Keranen
-
Patent number: 11240532Abstract: An apparatus includes circuitry configured to: receive information to cull one or more sets of components belonging to the same atlas from at least one volumetric video bitstream; wherein the information comprises one or more of: atlas-to-view mapping metadata indicating an association between patches in at least one atlas and at least one view; atlas-to-object mapping metadata indicating an association between at least one object and the at least one atlas; patch atlas metadata within a metadata for immersive video master atlas to indicate sub-bitstream culling based on fine-grained patch visibility culling; or partial access metadata, wherein leveraging the partial access metadata comprises storing each of the at least one atlas in its own track, and providing sample grouping information to indicate culling on a file format level; and cull the one or more sets of components from the at least one volumetric video bitstream, based on the information.Type: GrantFiled: March 1, 2021Date of Patent: February 1, 2022Assignee: Nokia Technologies OyInventors: Kimmo Tapio Roimela, Lauri Ilola, Vinod Kumar Malamal Vadakital, Lukasz Kondrad
-
Publication number: 20210383590Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: provide patch metadata to signal view-dependent transformations of a texture layer of volumetric data; provide the patch metadata to comprise at least one of: a depth offset of the texture layer with respect to a geometry surface, or texture transformation parameters; and wherein the patch metadata enables a renderer to offset texture coordinates of the texture layer based on a viewing position.Type: ApplicationFiled: May 26, 2021Publication date: December 9, 2021Inventors: Kimmo Tapio Roimela, Vinod Kumar Malamal Vadakital, Lauri Ilola, Lukasz Kondrad, Jaakko Keranen
-
Publication number: 20210281879Abstract: An apparatus includes circuitry configured to: receive information to cull one or more sets of components belonging to the same atlas from at least one volumetric video bitstream; wherein the information comprises one or more of: atlas-to-view mapping metadata indicating an association between patches in at least one atlas and at least one view; atlas-to-object mapping metadata indicating an association between at least one object and the at least one atlas; patch atlas metadata within a metadata for immersive video master atlas to indicate sub-bitstream culling based on fine-grained patch visibility culling; or partial access metadata, wherein leveraging the partial access metadata comprises storing each of the at least one atlas in its own track, and providing sample grouping information to indicate culling on a file format level; and cull the one or more sets of components from the at least one volumetric video bitstream, based on the information.Type: ApplicationFiled: March 1, 2021Publication date: September 9, 2021Inventors: Kimmo Tapio ROIMELA, Lauri Ilola, Vinod Kumar Malamal Vadakital, Lukasz Kondrad
-
Publication number: 20210218999Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide signal information to identify an atlas identifier on a sample of a volumetric media track, or on the volumetric media track in a multi-track container; wherein the signal information allows a file parser to link volumetric media tracks with different atlas identifiers that originate from a volumetric media elementary stream; and wherein the file parser is able to reconstruct the volumetric media elementary stream based on the signal information and data encapsulated in the multi-track container.Type: ApplicationFiled: January 4, 2021Publication date: July 15, 2021Inventors: Sebastian SCHWARZ, Lukasz KONDRAD, Emre AKSU, Lauri ILOLA, Vinod Kumar MALAMAL VADAKITAL, Miska Matias HANNUKSELA
-
Publication number: 20210209829Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: receive a scene description comprising data associated with a scene; place the data associated with the scene into data buffers and create command buffers; adapt the data placed within the data buffers and synchronize the data within the data buffers with information provided from local media or network media; signal information about the adaptation to update the command buffers that command a renderer; and render the scene using the data within the data buffers and the command buffers.Type: ApplicationFiled: December 28, 2020Publication date: July 8, 2021Inventors: Lauri Ilola, Lukasz Kondrad, Emre Aksu, Miska Matias Hannuksela, Sebastian Schwarz
-
Publication number: 20210097724Abstract: Apparatuses, methods, and computer programs are disclosed. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: signal a depth start of a patch data unit of a patch of data content based on an identifier of a tile and a patch index; wherein the depth start is used to derive a range of at least one depth value for the patch based on the patch index in a tile having the identifier; and signal a depth threshold of an immersive video extension of the patch data unit; wherein the depth threshold specifies a threshold below which an occupancy value is defined to be unoccupied for the patch based on the patch index.Type: ApplicationFiled: September 29, 2020Publication date: April 1, 2021Inventors: Kimmo Tapio Roimela, Vinod Kumar Malamal Vadakital, Lauri Ilola
-
Publication number: 20210092444Abstract: Apparatuses, methods, and computer programs are disclosed to implement six degrees of freedom spatial layout signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: segment a scene of volumetric video into one or more sequences, each sequence comprising one or more sub viewing volumes having one or more bitstream alternatives; generate viewing volume and view point indications within one or more dynamic adaptive streaming over hypertext transfer protocol media presentation description files; generate one or more sub volume scheme uniform resource identifiers for client side instructions to retrieve content; and provide one or more of the sub viewing volumes based on a client selection and request.Type: ApplicationFiled: September 14, 2020Publication date: March 25, 2021Inventors: Lauri ILOLA, Kimmo ROIMELA, Vinod Kumar Malamal VADAKITAL, Jaakko KERANEN
-
Publication number: 20210092430Abstract: Apparatuses, methods, and computer programs are disclosed to implement video-based cloud compression model to world signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide first signaling information comprising information related to a world domain, wherein the world domain is a point cloud frame that is represented by a number of points in a first volumetric coordinate system; and provide second signaling information comprising information related to a conversion of a model domain to the world domain, wherein the model domain represents the point cloud frame by a number of points in a second volumetric coordinate system.Type: ApplicationFiled: September 16, 2020Publication date: March 25, 2021Inventors: Sebastian Schwarz, Lukasz KONDRAD, Kimmo ROIMELA, Lauri ILOLA