Patents by Inventor Jani Lainema

Jani Lainema has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240121387
    Abstract: An example method includes: receiving an input extended block comprising an input block and input margins, wherein the input block is derived from an image or a video frame, and wherein the input block and the input margins are input to a filter, and wherein the input margins comprise pixels of the image or the video frame; filtering the input extended block to obtain a filtered extended block comprising a filtered block and filtered margins; receiving other blocks, wherein the other blocks are derived from the image or video frame, and wherein at least one pixel of the other blocks overlaps with at least one pixel of the filtered margins of the filtered extended block; and blending the filtered extended block with the other blocks, wherein an operation to blend the filtered extended block with the other blocks is applied to two or more overlapping pixels
    Type: Application
    Filed: September 20, 2023
    Publication date: April 11, 2024
    Inventors: Jani LAINEMA, Francesco CRICRÌ, Ramin GHAZNAVI YOUVALARI, Miska Matias HANNUKSELA, Honglei ZHANG, Maria Claudia SANTAMARIA GOMEZ, Ruiying YANG
  • Publication number: 20240064311
    Abstract: The embodiments relate to a method comprising obtaining sample values of a target area in a picture to be encoded (310); obtaining sample values of a regressor area in a picture to be encoded (320); determining at least one set of prediction coefficients by means of a linear regression (330); predicting the sample values of the target area using the determined at least one set of prediction coefficients to result in a first predicted sample values (340); determining best performing set of prediction coefficients (350); predicting the sample values of the target area using the best performing set of prediction coefficients (360); encoding an indication indicating the best performing set of prediction coefficients along the bitstream (370), and iterating the steps for all target areas in the picture to be encoded (380). The embodiments also relate to a decoding method, and apparatuses for encoding and decoding.
    Type: Application
    Filed: December 17, 2021
    Publication date: February 22, 2024
    Inventors: Pekka ASTOLA, Alireza AMINLOU, Jani LAINEMA
  • Publication number: 20240064326
    Abstract: Apparatuses, methods and computer programs are provided for utilizing motion prediction in video coding. A block of pixels of a video representation encoded in a bitstream is read, and a type of the block is determined. If the determining indicates that the block is a block predicted by using two or more reference blocks, a first reference pixel location in a first reference block is determined and a second reference pixel location in a second reference block is determined. The first reference pixel location is used to obtain a first prediction. The first prediction has a second precision, which is higher than the first precision. The second reference pixel location is used to obtain a second prediction, which also has the second precision. The first prediction and the second prediction are combined to obtain a combined prediction; and the precision of the combined prediction is reduced to the first precision.
    Type: Application
    Filed: October 30, 2023
    Publication date: February 22, 2024
    Applicant: NOKIA TECHNOLOGIES OY
    Inventors: Kemal UGUR, Jani LAINEMA, Antti HALLAPURO
  • Publication number: 20240007672
    Abstract: A method comprising: determining a first sample in an input color space (500); determining a component of the input color space that the first sample represents (502); determining a pre-quantizer based on the determined component (504); quantizing the first sample using the determined pre-quantizer (506); and encoding the first sample value with video or image coding means (508).
    Type: Application
    Filed: September 29, 2021
    Publication date: January 4, 2024
    Inventors: Jani LAINEMA, Ramin GHAZNAVI YOUVALARI
  • Patent number: 11805267
    Abstract: Apparatuses, methods and computer programs are provided for utilizing motion prediction in video coding. A block of pixels of a video representation encoded in a bitstream is read, and a type of the block is determined. If the determining indicates that the block is a block predicted by using two or more reference blocks, a first reference pixel location in a first reference block is determined and a second reference pixel location in a second reference block is determined. The first reference pixel location is used to obtain a first prediction. The first prediction has a second precision, which is higher than the first precision. The second reference pixel location is used to obtain a second prediction, which also has the second precision. The first prediction and the second prediction are combined to obtain a combined prediction; and the precision of the combined prediction is reduced to the first precision.
    Type: Grant
    Filed: May 24, 2021
    Date of Patent: October 31, 2023
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Kemal Ugur, Jani Lainema, Antti Hallapuro
  • Publication number: 20230262223
    Abstract: The embodiments relate to a method and a technical equipment for implementing the method. The method includes receiving a picture to be encoded; performing at least one prediction according to a first prediction mode for samples inside a block of the picture in a current channel; deriving an intra prediction mode from at least one coded block in a reference channel; performing at least one other prediction according to the derived intra prediction mode for the samples inside the block of the picture; and determining a final prediction of the block based on said at least one first and at least one second predictions with weights.
    Type: Application
    Filed: May 27, 2021
    Publication date: August 17, 2023
    Inventors: Ramin GHAZNAVI YOUVALARI, Jani LAINEMA
  • Publication number: 20230196072
    Abstract: Various embodiments provide an apparatus, a method, and a computer program product. An example apparatus includes at least one processor; and at least one non-transitory memory comprising computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: determine a subset of parameters to overfit from a set of candidate parameters of decoder side neural network to be overfitted (OPs); wherein the subset of parameters to overfit is smaller than the set of candidate parameters to be overfitted; and overfit the determined subset of parameters.
    Type: Application
    Filed: December 16, 2021
    Publication date: June 22, 2023
    Inventors: Nannan ZOU, Francesco CRICRÌ, Honglei ZHANG, Hamed REZAZADEGAN TAVAKOLI, Jani LAINEMA, Miska Matias HANNUKSELA
  • Publication number: 20230179792
    Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.
    Type: Application
    Filed: January 30, 2023
    Publication date: June 8, 2023
    Applicant: NOKIA TECHNOLOGIES OY
    Inventors: Mehmet Oguz BICI, Jani LAINEMA, Kemal UGUR
  • Publication number: 20230169372
    Abstract: Various embodiments provide an apparatus, a method, and a computer program product. 1. An apparatus incudes at least one processor; and at least one non-transitory memory includes computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: perform an overfitting operation, at an encoder side, to obtain an overfitted probability model, wherein overfitting comprises one or more training operations applied to a probability model, wherein one or more parameters of the probability model are trained; use the overfitted probability model to provide probability estimates to a lossless codec or a substantially lossless codec for encoding data or a portion of the data; and signal information to a decoder on whether to perform the overfitting operation at the decoder side.
    Type: Application
    Filed: December 1, 2021
    Publication date: June 1, 2023
    Inventors: Nannan ZOU, Francesco CRICRÌ, Honglei ZHANG, Hamed REZAZADEGAN TAVAKOLI, Jani LAINEMA, Miska Matias HANNUKSELA
  • Publication number: 20230128882
    Abstract: A method, apparatus, and computer program product provide for improving parameter selection decisions in hybrid video and image codecs. In the context of a method, the method generates a block of difference samples based on a difference between a first block of samples and a second block of samples. The method also generates a block of transform coefficients by applying a transformation process to the block of difference samples. The method also determines an absolute value for each transform coefficient in the block of transform coefficients and determines a weighted sum value for all absolute values of the transform coefficients within the block of transform coefficients. The method also applies the weighted sum value as a criterion for a selection decision.
    Type: Application
    Filed: March 18, 2021
    Publication date: April 27, 2023
    Applicant: NOKIA TECHNOLOGIES OY
    Inventor: Jani LAINEMA
  • Publication number: 20230110503
    Abstract: The embodiments relate to method for encoding and decoding, wherein the method for encoding comprises receiving an input block of a video frame for encoding; applying at least a learning-based model (702) for said input block as a processing step for encoding the block; combining (703) an output of a learning-based model with one or more data sources (712, 713) by a combination process; encoding block to a bitstream (40); using a result of the combination process as additional input for the learning-based model for encoding a subsequent block; and encoding to a bitstream combination information (720) used in the combination process, said combination information comprising at least one or more combination parameters. The embodiments also relate to technical equipment for implementing the methods.
    Type: Application
    Filed: February 4, 2021
    Publication date: April 13, 2023
    Inventors: Jani LAINEMA, Emre Baris AKSU, Miska Matias HANNUKSELA, Alireza ZARE, Francesco CRICRI
  • Patent number: 11622119
    Abstract: A method includes maintaining a set of parameters or weights derived through online learning for a neural net; transmitting an update of the parameters or weights to a decoder; deriving a first prediction block based on an output of the neural net using the parameters or weights; deriving a first encoded prediction error block through encoding a difference of the first prediction block and a first input block; encoding the first encoded prediction error block into a bitstream; deriving a reconstructed prediction error block based on the first encoded prediction error block; deriving a second prediction block based on an output of the neural net using the parameters or weights and the reconstructed prediction error block; deriving a second encoded prediction error block through encoding a difference of the second prediction block and a second input block; and encoding the second encoded prediction error block into a bitstream.
    Type: Grant
    Filed: January 14, 2022
    Date of Patent: April 4, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Miska Hannuksela, Mikko Honkala, Jani Lainema, Francesco Cricri, Emre Aksu
  • Publication number: 20230062752
    Abstract: The embodiments relate to a method for encoding and a decoding, and apparatuses for the same. The method for encoding comprises receiving a block of a video frame for encoding (1510); making a decision on whether or not a learning-based model is to be applied as a processing step for encoding the block (1520); applying the learning-based model for said input block according to the decision, where the learning-based model has been selectively fine-tuned according to information relating to activation of the learning-based model of previously-decoded blocks (1530); encoding a signal corresponding to the decision on usage of the learning-based model into a bitstream (1540); and encoding the block into a bitstream with an information whether the block is to be used for finetuning (1550).
    Type: Application
    Filed: February 12, 2021
    Publication date: March 2, 2023
    Inventors: Jani LAINEMA, Francesco CRICRI, Emre Baris AKSU, Alireza ZARE, Miska Matias HANNUKSELA
  • Patent number: 11570467
    Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: January 31, 2023
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Mehmet Oguz Bici, Jani Lainema, Kemal Ugur
  • Patent number: 11558628
    Abstract: An apparatus includes circuitry configured to: partition an input tensor into one or more block tensors; partition at least one of the block tensors into one or more continuation bands, the one or more continuation bands being associated with a caching counter having a value; store the one or more continuation bands in a cache managed using a cache manager; retrieve, prior to a convolution or pooling operation on a current block tensor, the one or more continuation bands of a previous block tensor from the cache that are adjacent to a current block tensor; concatenate the retrieved continuation bands with the current block tensor; apply the convolution or pooling operation on the current block tensor after the concatenation; decrease the respective caching counter value of the retrieved continuation bands; and clear the continuation bands from the cache when its respective caching counter reaches a value of zero.
    Type: Grant
    Filed: December 13, 2021
    Date of Patent: January 17, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Honglei Zhang, Francesco Cricri, Hamed Rezazadegan Tavakoli, Jani Lainema, Emre Aksu, Nannan Zou
  • Publication number: 20220400283
    Abstract: A system and method for improving the coding efficiency of motion vector information in video coding. According to various embodiments, a list of motion vector predictor candidates is arranged according to predefined rules. Each motion vector also has a reference index associated with it. One of the motion vector candidates is then selected as a predictor based on predefined rules, or the selection is explicitly signaled in the bitstream. The reference index associated with the selected motion vector is used as a reference index for the current block. The reference index is predicted along with the motion vector. Such embodiments can improve the compression efficiency of modern video codecs.
    Type: Application
    Filed: August 22, 2022
    Publication date: December 15, 2022
    Applicant: NOKIA TECHNOLOGIES OY
    Inventors: Antti Olli HALLAPURO, Kemal UGUR, Jani LAINEMA
  • Patent number: 11457244
    Abstract: A method comprising: obtaining a block of a picture or a picture in an encoder; determining if the block/picture is used for on-line learning; if affirmative, encoding the block/picture; reconstructing a coarse version of the block/picture or the respective prediction error block/picture; enhancing the coarse version using a neural net; fine-tuning the neural net with a training signal based on the coarse version; determining if the block/picture is enhanced using the neural net; and if affirmative, encoding the block/picture with enhancing using the neural net.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: September 27, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Miska Hannuksela, Jani Lainema, Francesco Cricri
  • Publication number: 20220303556
    Abstract: There is disclosed an apparatus, a method and a computer program for video coding. The apparatus comprises a selector configured for selecting a pixel for prediction; a projection definer configured for determining a projection of said pixel to a set of reference pixels; and a prediction definer configured for selecting one or more reference pixels from said set of reference pixels on the basis of said projection, and using said selected one or more reference pixels to obtain a prediction value for said pixel to be predicted.
    Type: Application
    Filed: June 9, 2022
    Publication date: September 22, 2022
    Applicant: NOKIA TECHNOLOGIES OY
    Inventors: Jani LAINEMA, Kemal UGUR
  • Publication number: 20220295104
    Abstract: There is disclosed a method comprising obtaining a block of transform coefficients; searching a position of a last non-zero coefficient in a scan order in the block; selecting a secondary transform mode based on the position and encoding first syntax elements indicative of the selected secondary transform mode. A primary transform mode is selected based on the secondary transform mode. Second syntax elements indicative of the selected primary transform mode and third syntax elements defining the transform coefficients within the block are encoded. There is also disclosed a method comprising receiving encoded information related to a block of transform coefficients; decoding an indication of a position of a last non-zero coefficient in a scan order in the block and using the position to determine if an indication of a secondary transform mode is present in the bit stream.
    Type: Application
    Filed: September 9, 2020
    Publication date: September 15, 2022
    Inventor: Jani LAINEMA
  • Patent number: 11425408
    Abstract: A system and method for improving the coding efficiency of motion vector information in video coding. According to various embodiments, a list of motion vector predictor candidates is arranged according to predefined rules. Each motion vector also has a reference index associated with it. One of the motion vector candidates is then selected as a predictor based on predefined rules, or the selection is explicitly signaled in the bitstream. The reference index associated with the selected motion vector is used as a reference index for the current block. The reference index is predicted along with the motion vector. Such embodiments can improve the compression efficiency of modern video codecs.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: August 23, 2022
    Assignee: NOKIA TECHNOLOGIES OY
    Inventors: Antti Olli Hallapuro, Kemal Ugur, Jani Lainema