Patents by Inventor Miska Matias Hannuksela

Miska Matias Hannuksela has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220247990
    Abstract: A method includes generating a bitstream defining a presentation, the presentation comprising an omnidirectional visual media content and a first visual media component and a second visual media component; indicating in the bitstream a first presentation timeline and a second presentation timeline; and indicating in the bitstream a switching mode with respect to the first presentation timeline associated with the first visual media component, or with respect to the second presentation timeline associated with the second visual media component, the switching mode being indicated dependent on a viewpoint of a user; wherein the switching mode provides an indication of switching to the first visual media component or to the second visual media component, the first visual media component corresponding to content captured from a first omnidirectional camera in a first location, and the second visual media component corresponding to content captured from a second omnidirectional camera in a second location.
    Type: Application
    Filed: April 21, 2022
    Publication date: August 4, 2022
    Inventors: Kashyap Kammachi Sreedhar, Igor Danilo Diego CURCIO, Miska Matias HANNUKSELA, Sujeet Shyamsundar MATE, Emre Baris AKSU
  • Patent number: 11403804
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: receive a scene description comprising data associated with a scene; place the data associated with the scene into data buffers and create command buffers; adapt the data placed within the data buffers and synchronize the data within the data buffers with information provided from local media or network media; signal information about the adaptation to update the command buffers that command a renderer; and render the scene using the data within the data buffers and the command buffers.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: August 2, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Lauri Ilola, Lukasz Kondrad, Emre Aksu, Miska Matias Hannuksela, Sebastian Schwarz
  • Patent number: 11375204
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: decode encoded data to generate decoded data, the encoded data having a bitrate lower than that of original data, and extract features from the decoded data; decode encoded residual features to generate decoded residual features; and generate enhanced decoded features as a result of combining the decoded residual features with the features extracted from the decoded data.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: June 28, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Honglei Zhang, Hamed Rezazadegan Tavakoli, Francesco Cricri, Miska Matias Hannuksela, Emre Aksu, Nam Le
  • Publication number: 20220167042
    Abstract: A method, apparatus and computer program product encode, into a media description, a first information item indicative of a first locator for segment metadata for a set of representations. The method, apparatus and computer program product encode, into the media description, one or more representation-specific information items indicative of representation-specific locator for segment media data for one or more representations of the set of representations. The method, apparatus and computer program product cause storage of the media description with the set of representations.
    Type: Application
    Filed: December 12, 2019
    Publication date: May 26, 2022
    Inventors: Miska Matias HANNUKSELA, Emre Baris AKSU, Ari HOURUNRANTA, Kashyap KAMMACHI-SREEDHAR, Igor Danilo Diego CURCIO
  • Patent number: 11341688
    Abstract: Optimization of a neural network, for example in a video codec at the decoder side, may be guided to limit overfitting. The encoder may encode video(s) with different qualities for different frames in the video. Low-quality frames may be used as both input and ground-truth during optimization. High-quality frames may be used to optimize the neural network so that higher-quality versions of lower-quality inputs may be predicted. The neural network may be trained to make such predictions by making a prediction based on a constructed low-quality input for which the corresponding high-quality version is known, comparing the prediction to the high-quality version, and fine-tuning the neural network to improve its ability to predict a high-quality version of a low-quality input. To limit overfitting, the neural network may be concurrently or in an alternating fashion trained with low-quality input for which a higher-quality version of the low-quality input is known.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: May 24, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Alireza Zare, Francesco Cricri, Yat Hong Lam, Miska Matias Hannuksela, Jani Olavi Lainema
  • Patent number: 11330279
    Abstract: There is provided methods, apparatuses and computer program products for video coding and decoding. A first part of a first coded video representation is decoded, and information on decoding a second coded video representation is received and parsed. The coded second representation differs from the first coded video representation in chroma format, sample bit depth, color gamut and/or spatial resolution, and the information indicates if the second coded video representation may be decoded using processed decoded pictures of the first coded video representation as reference pictures.
    Type: Grant
    Filed: November 11, 2019
    Date of Patent: May 10, 2022
    Assignee: NOKIA TECHNOLOGIES OY
    Inventor: Miska Matias Hannuksela
  • Patent number: 11323683
    Abstract: The invention relates to a solution wherein a bitstream defining a presentation is generated, the presentation comprising an omnidirectional visual media content and a first visual media component and a second visual media component; indicating in the bitstream a first presentation timeline associated with the first visual media component; indicating in the bitstream a second presentation timeline associated with the second visual media component; indicating in the bitstream a switching mode to a second presentation timeline associated with the second visual media component; and indicating in the bitstream, that the switching mode is with respect to the first presentation timeline or to the second presentation timeline.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: May 3, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Kashyap Kammachi Sreedhar, Igor Danilo Diego Curcio, Miska Matias Hannuksela, Sujeet Shyamsundar Mate, Emre Baris Aksu
  • Publication number: 20220124360
    Abstract: A reference picture marking process and a reference picture list management process is handled in a unified reference picture marking and reference picture list management process. A new idle reference picture list may be used for handling reference pictures that are not used for reference in the current picture. Differential coding of picture order count may be used to increase coding efficiency. The reference picture management syntax structure may be sent in the picture parameter set for improved coding efficiency e.g. in regular GOP (group of pictures) arrangements.
    Type: Application
    Filed: December 27, 2021
    Publication date: April 21, 2022
    Applicant: NOKIA TECHOLOGIES OY
    Inventors: Miska Matias HANNUKSELA, Srikanth Manchenahally GOPALAKRISHNA
  • Publication number: 20220109861
    Abstract: An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: indicate an extraction reference map entry used to assign a group identifier to at least one extraction reference, the extraction reference map entry indicating a subpicture layout; wherein the at least one extraction reference causes extraction of a network abstraction layer unit data by reference from another track; wherein the at least one extraction reference comprises an index of a track reference having a subpicture type within a subpicture order sample group description entry; and indicate, using the at least one extraction reference, subpictures or slices of a coded picture in decoding order.
    Type: Application
    Filed: October 7, 2021
    Publication date: April 7, 2022
    Inventors: Miska Matias Hannuksela, Kashyap Kammachi Sreedhar, Emre Aksu
  • Publication number: 20220086480
    Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments a method comprises at least one of the following: encoding into a bitstream an indication that motion fields are stored, but only for inter-layer motion prediction; encoding into a bitstream an indication on a limited scope of motion field usage; encoding into a bitstream an indication whether or not to use the motion field for prediction; encoding into a bitstream an indication of storage parameters for storing motion information.
    Type: Application
    Filed: November 22, 2021
    Publication date: March 17, 2022
    Applicant: NOKIA TECHNOLOGIES OY
    Inventor: Miska Matias HANNUKSELA
  • Publication number: 20220038733
    Abstract: A method comprising encoding a bitstream comprising a base layer, a first enhancement layer and a second enhancement layer; encoding an indication of both the base layer and the first enhancement layer used for prediction for the second enhancement layer in the bitstream; encoding, in the bitstream, an indication of a first set of prediction types that is applicable from the base layer to the second enhancement layer, wherein the first set of prediction types is a subset of all prediction types available for prediction between layers, and encoding, in the bitstream, an indication of a second set of prediction types that is applicable from the base layer or the first enhancement layer to the second enhancement layer, wherein the second set of prediction types is a subset of all prediction types available for prediction between layers.
    Type: Application
    Filed: October 18, 2021
    Publication date: February 3, 2022
    Applicant: NOKIA TECHNOLOGIES OY
    Inventors: Miska Matias HANNUKSELA, Kemal UGUR
  • Publication number: 20220021864
    Abstract: A user equipment, media control unit, media resource function, or another device or function capable of receiving, manipulating, and transmitting data may be configured to: receive an omnidirectional video; determine a viewport of a user equipment; determining a delivery mode; determine a region of the omnidirectional video based, at least partially, on the determined viewport and the determined delivery mode; encode the determined region; packetizing the encoded region; and transmit the packetized region to the user equipment based, at least partially, on the determined delivery mode.
    Type: Application
    Filed: July 15, 2021
    Publication date: January 20, 2022
    Inventors: Sujeet Shyamsundar MATE, Igor Danilo Diego CURCIO, Saba AHSAN, Emre AKSU, Miska Matias HANNUKSELA, Yu YOU
  • Patent number: 11212546
    Abstract: A reference picture marking process and a reference picture list management process is handled in a unified reference picture marking and reference picture list management process. A new idle reference picture list may be used for handling reference pictures that are not used for reference in the current picture. Differential coding of picture order count may be used to increase coding efficiency. The reference picture management syntax structure may be sent in the picture parameter set for improved coding efficiency e.g. in regular GOP (group of pictures) arrangements.
    Type: Grant
    Filed: March 9, 2020
    Date of Patent: December 28, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Miska Matias Hannuksela, Srikanth Manchenahally Gopalakrishna
  • Publication number: 20210397965
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: estimate an importance of parameters of a neural network based on a graph diffusion process over at least one layer of the neural network; determine the parameters of the neural network that are suitable for pruning or sparsification; remove neurons of the neural network to prune or sparsify the neural network; and provide at least one syntax element for signaling the pruned or sparsified neural network over a communication channel, wherein the at least one syntax element comprises at least one neural network representation syntax element.
    Type: Application
    Filed: June 22, 2021
    Publication date: December 23, 2021
    Inventors: Honglei ZHANG, Francesco CRICRI, Hamed REZAZADEGAN TAVAKOLI, Joachim WABNIG, Iraj SANIEE, Miska Matias HANNUKSELA, Emre AKSU
  • Patent number: 11200701
    Abstract: A method, apparatus and computer program product access a video-based point cloud compression coded bitstream. The point cloud compression coded bitstream corresponds to a non-timed video-based point cloud compression representation that comprises one or more video point cloud compression units. The method, apparatus and computer program product encapsulate the one or more video point cloud compression units as one or more video point cloud compression unit items. The method, apparatus and computer program product also cause storage of the one or more video point cloud compression unit items in a file.
    Type: Grant
    Filed: March 19, 2020
    Date of Patent: December 14, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Emre Baris Aksu, Miska Matias Hannuksela
  • Patent number: 11184634
    Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments a method comprises at least one of the following: encoding into a bitstream an indication that motion fields are stored, but only for inter-layer motion prediction; encoding into a bitstream an indication on a limited scope of motion field usage; encoding into a bitstream an indication whether or not to use the motion field for prediction; encoding into a bitstream an indication of storage parameters for storing motion information.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: November 23, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventor: Miska Matias Hannuksela
  • Patent number: 11172005
    Abstract: A method, apparatus and computer program product are provided to provide the rendering of audiovisual content, such as 360-degree virtual reality content, in a manner that allows for control over whether, and to what degree, the content presented to a viewer should take into account the relative positioning of the content with respect to the viewer. In particular, implementations are presented that allow for situational control over the rendering of content based on an initial observation setup associated with a segment or subsegment of content, the orientation of the viewing device, and/or the manner in which the segment or subsegment is accessed by a playback device.
    Type: Grant
    Filed: September 9, 2016
    Date of Patent: November 9, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Miska Matias Hannuksela, Payman Aflaki-Beni
  • Patent number: 11172208
    Abstract: A method, apparatus and computer program products are provided for capturing omnidirectional video with one or more cameras, streaming the video over a network, and rendering the video on a Head Mounted Display (HMD) and more specifically to a method, apparatus, and computer program product for improving the visual quality of viewport-based omnidirectional video streaming. One example method includes selecting a primary viewport, encoding a first representation that covers the primary viewport, and encoding a second representation that provides a gradual picture quality change from a background viewport to the primary viewport.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: November 9, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Igor Danilo Diego Curcio, Miska Matias Hannuksela, Justin Ridge
  • Patent number: 11153592
    Abstract: A method comprising encoding a bitstream comprising a base layer, a first enhancement layer and a second enhancement layer; encoding an indication of both the base layer and the first enhancement layer used for prediction for the second enhancement layer in the bitstream; encoding, in the bitstream, an indication of a first set of prediction types that is applicable from the base layer to the second enhancement layer, wherein the first set of prediction types is a subset of all prediction types available for prediction between layers, and encoding, in the bitstream, an indication of a second set of prediction types that is applicable from the base layer or the first enhancement layer to the second enhancement layer, wherein the second set of prediction types is a subset of all prediction types available for prediction between layers.
    Type: Grant
    Filed: November 20, 2019
    Date of Patent: October 19, 2021
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Miska Matias Hannuksela, Kemal Ugur
  • Publication number: 20210314573
    Abstract: An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: decode encoded data to generate decoded data, the encoded data having a bitrate lower than that of original data, and extract features from the decoded data; decode encoded residual features to generate decoded residual features; and generate enhanced decoded features as a result of combining the decoded residual features with the features extracted from the decoded data.
    Type: Application
    Filed: March 31, 2021
    Publication date: October 7, 2021
    Inventors: Honglei Zhang, Hamed Rezazadegan Tavakoli, Francesco Cricri, Miska Matias Hannuksela, Emre Aksu, Nam Le