Patents by Inventor Jani Lainema
Jani Lainema has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240121387Abstract: An example method includes: receiving an input extended block comprising an input block and input margins, wherein the input block is derived from an image or a video frame, and wherein the input block and the input margins are input to a filter, and wherein the input margins comprise pixels of the image or the video frame; filtering the input extended block to obtain a filtered extended block comprising a filtered block and filtered margins; receiving other blocks, wherein the other blocks are derived from the image or video frame, and wherein at least one pixel of the other blocks overlaps with at least one pixel of the filtered margins of the filtered extended block; and blending the filtered extended block with the other blocks, wherein an operation to blend the filtered extended block with the other blocks is applied to two or more overlapping pixelsType: ApplicationFiled: September 20, 2023Publication date: April 11, 2024Inventors: Jani LAINEMA, Francesco CRICRÌ, Ramin GHAZNAVI YOUVALARI, Miska Matias HANNUKSELA, Honglei ZHANG, Maria Claudia SANTAMARIA GOMEZ, Ruiying YANG
-
Publication number: 20240064311Abstract: The embodiments relate to a method comprising obtaining sample values of a target area in a picture to be encoded (310); obtaining sample values of a regressor area in a picture to be encoded (320); determining at least one set of prediction coefficients by means of a linear regression (330); predicting the sample values of the target area using the determined at least one set of prediction coefficients to result in a first predicted sample values (340); determining best performing set of prediction coefficients (350); predicting the sample values of the target area using the best performing set of prediction coefficients (360); encoding an indication indicating the best performing set of prediction coefficients along the bitstream (370), and iterating the steps for all target areas in the picture to be encoded (380). The embodiments also relate to a decoding method, and apparatuses for encoding and decoding.Type: ApplicationFiled: December 17, 2021Publication date: February 22, 2024Inventors: Pekka ASTOLA, Alireza AMINLOU, Jani LAINEMA
-
Publication number: 20240064326Abstract: Apparatuses, methods and computer programs are provided for utilizing motion prediction in video coding. A block of pixels of a video representation encoded in a bitstream is read, and a type of the block is determined. If the determining indicates that the block is a block predicted by using two or more reference blocks, a first reference pixel location in a first reference block is determined and a second reference pixel location in a second reference block is determined. The first reference pixel location is used to obtain a first prediction. The first prediction has a second precision, which is higher than the first precision. The second reference pixel location is used to obtain a second prediction, which also has the second precision. The first prediction and the second prediction are combined to obtain a combined prediction; and the precision of the combined prediction is reduced to the first precision.Type: ApplicationFiled: October 30, 2023Publication date: February 22, 2024Applicant: NOKIA TECHNOLOGIES OYInventors: Kemal UGUR, Jani LAINEMA, Antti HALLAPURO
-
Publication number: 20240007672Abstract: A method comprising: determining a first sample in an input color space (500); determining a component of the input color space that the first sample represents (502); determining a pre-quantizer based on the determined component (504); quantizing the first sample using the determined pre-quantizer (506); and encoding the first sample value with video or image coding means (508).Type: ApplicationFiled: September 29, 2021Publication date: January 4, 2024Inventors: Jani LAINEMA, Ramin GHAZNAVI YOUVALARI
-
Patent number: 11805267Abstract: Apparatuses, methods and computer programs are provided for utilizing motion prediction in video coding. A block of pixels of a video representation encoded in a bitstream is read, and a type of the block is determined. If the determining indicates that the block is a block predicted by using two or more reference blocks, a first reference pixel location in a first reference block is determined and a second reference pixel location in a second reference block is determined. The first reference pixel location is used to obtain a first prediction. The first prediction has a second precision, which is higher than the first precision. The second reference pixel location is used to obtain a second prediction, which also has the second precision. The first prediction and the second prediction are combined to obtain a combined prediction; and the precision of the combined prediction is reduced to the first precision.Type: GrantFiled: May 24, 2021Date of Patent: October 31, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Kemal Ugur, Jani Lainema, Antti Hallapuro
-
Publication number: 20230262223Abstract: The embodiments relate to a method and a technical equipment for implementing the method. The method includes receiving a picture to be encoded; performing at least one prediction according to a first prediction mode for samples inside a block of the picture in a current channel; deriving an intra prediction mode from at least one coded block in a reference channel; performing at least one other prediction according to the derived intra prediction mode for the samples inside the block of the picture; and determining a final prediction of the block based on said at least one first and at least one second predictions with weights.Type: ApplicationFiled: May 27, 2021Publication date: August 17, 2023Inventors: Ramin GHAZNAVI YOUVALARI, Jani LAINEMA
-
Publication number: 20230196072Abstract: Various embodiments provide an apparatus, a method, and a computer program product. An example apparatus includes at least one processor; and at least one non-transitory memory comprising computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: determine a subset of parameters to overfit from a set of candidate parameters of decoder side neural network to be overfitted (OPs); wherein the subset of parameters to overfit is smaller than the set of candidate parameters to be overfitted; and overfit the determined subset of parameters.Type: ApplicationFiled: December 16, 2021Publication date: June 22, 2023Inventors: Nannan ZOU, Francesco CRICRÌ, Honglei ZHANG, Hamed REZAZADEGAN TAVAKOLI, Jani LAINEMA, Miska Matias HANNUKSELA
-
Publication number: 20230179792Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.Type: ApplicationFiled: January 30, 2023Publication date: June 8, 2023Applicant: NOKIA TECHNOLOGIES OYInventors: Mehmet Oguz BICI, Jani LAINEMA, Kemal UGUR
-
Publication number: 20230169372Abstract: Various embodiments provide an apparatus, a method, and a computer program product. 1. An apparatus incudes at least one processor; and at least one non-transitory memory includes computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: perform an overfitting operation, at an encoder side, to obtain an overfitted probability model, wherein overfitting comprises one or more training operations applied to a probability model, wherein one or more parameters of the probability model are trained; use the overfitted probability model to provide probability estimates to a lossless codec or a substantially lossless codec for encoding data or a portion of the data; and signal information to a decoder on whether to perform the overfitting operation at the decoder side.Type: ApplicationFiled: December 1, 2021Publication date: June 1, 2023Inventors: Nannan ZOU, Francesco CRICRÌ, Honglei ZHANG, Hamed REZAZADEGAN TAVAKOLI, Jani LAINEMA, Miska Matias HANNUKSELA
-
Publication number: 20230128882Abstract: A method, apparatus, and computer program product provide for improving parameter selection decisions in hybrid video and image codecs. In the context of a method, the method generates a block of difference samples based on a difference between a first block of samples and a second block of samples. The method also generates a block of transform coefficients by applying a transformation process to the block of difference samples. The method also determines an absolute value for each transform coefficient in the block of transform coefficients and determines a weighted sum value for all absolute values of the transform coefficients within the block of transform coefficients. The method also applies the weighted sum value as a criterion for a selection decision.Type: ApplicationFiled: March 18, 2021Publication date: April 27, 2023Applicant: NOKIA TECHNOLOGIES OYInventor: Jani LAINEMA
-
Publication number: 20230110503Abstract: The embodiments relate to method for encoding and decoding, wherein the method for encoding comprises receiving an input block of a video frame for encoding; applying at least a learning-based model (702) for said input block as a processing step for encoding the block; combining (703) an output of a learning-based model with one or more data sources (712, 713) by a combination process; encoding block to a bitstream (40); using a result of the combination process as additional input for the learning-based model for encoding a subsequent block; and encoding to a bitstream combination information (720) used in the combination process, said combination information comprising at least one or more combination parameters. The embodiments also relate to technical equipment for implementing the methods.Type: ApplicationFiled: February 4, 2021Publication date: April 13, 2023Inventors: Jani LAINEMA, Emre Baris AKSU, Miska Matias HANNUKSELA, Alireza ZARE, Francesco CRICRI
-
Patent number: 11622119Abstract: A method includes maintaining a set of parameters or weights derived through online learning for a neural net; transmitting an update of the parameters or weights to a decoder; deriving a first prediction block based on an output of the neural net using the parameters or weights; deriving a first encoded prediction error block through encoding a difference of the first prediction block and a first input block; encoding the first encoded prediction error block into a bitstream; deriving a reconstructed prediction error block based on the first encoded prediction error block; deriving a second prediction block based on an output of the neural net using the parameters or weights and the reconstructed prediction error block; deriving a second encoded prediction error block through encoding a difference of the second prediction block and a second input block; and encoding the second encoded prediction error block into a bitstream.Type: GrantFiled: January 14, 2022Date of Patent: April 4, 2023Assignee: Nokia Technologies OyInventors: Miska Hannuksela, Mikko Honkala, Jani Lainema, Francesco Cricri, Emre Aksu
-
Publication number: 20230062752Abstract: The embodiments relate to a method for encoding and a decoding, and apparatuses for the same. The method for encoding comprises receiving a block of a video frame for encoding (1510); making a decision on whether or not a learning-based model is to be applied as a processing step for encoding the block (1520); applying the learning-based model for said input block according to the decision, where the learning-based model has been selectively fine-tuned according to information relating to activation of the learning-based model of previously-decoded blocks (1530); encoding a signal corresponding to the decision on usage of the learning-based model into a bitstream (1540); and encoding the block into a bitstream with an information whether the block is to be used for finetuning (1550).Type: ApplicationFiled: February 12, 2021Publication date: March 2, 2023Inventors: Jani LAINEMA, Francesco CRICRI, Emre Baris AKSU, Alireza ZARE, Miska Matias HANNUKSELA
-
Patent number: 11570467Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.Type: GrantFiled: January 13, 2020Date of Patent: January 31, 2023Assignee: NOKIA TECHNOLOGIES OYInventors: Mehmet Oguz Bici, Jani Lainema, Kemal Ugur
-
Patent number: 11558628Abstract: An apparatus includes circuitry configured to: partition an input tensor into one or more block tensors; partition at least one of the block tensors into one or more continuation bands, the one or more continuation bands being associated with a caching counter having a value; store the one or more continuation bands in a cache managed using a cache manager; retrieve, prior to a convolution or pooling operation on a current block tensor, the one or more continuation bands of a previous block tensor from the cache that are adjacent to a current block tensor; concatenate the retrieved continuation bands with the current block tensor; apply the convolution or pooling operation on the current block tensor after the concatenation; decrease the respective caching counter value of the retrieved continuation bands; and clear the continuation bands from the cache when its respective caching counter reaches a value of zero.Type: GrantFiled: December 13, 2021Date of Patent: January 17, 2023Assignee: Nokia Technologies OyInventors: Honglei Zhang, Francesco Cricri, Hamed Rezazadegan Tavakoli, Jani Lainema, Emre Aksu, Nannan Zou
-
Publication number: 20220400283Abstract: A system and method for improving the coding efficiency of motion vector information in video coding. According to various embodiments, a list of motion vector predictor candidates is arranged according to predefined rules. Each motion vector also has a reference index associated with it. One of the motion vector candidates is then selected as a predictor based on predefined rules, or the selection is explicitly signaled in the bitstream. The reference index associated with the selected motion vector is used as a reference index for the current block. The reference index is predicted along with the motion vector. Such embodiments can improve the compression efficiency of modern video codecs.Type: ApplicationFiled: August 22, 2022Publication date: December 15, 2022Applicant: NOKIA TECHNOLOGIES OYInventors: Antti Olli HALLAPURO, Kemal UGUR, Jani LAINEMA
-
Patent number: 11457244Abstract: A method comprising: obtaining a block of a picture or a picture in an encoder; determining if the block/picture is used for on-line learning; if affirmative, encoding the block/picture; reconstructing a coarse version of the block/picture or the respective prediction error block/picture; enhancing the coarse version using a neural net; fine-tuning the neural net with a training signal based on the coarse version; determining if the block/picture is enhanced using the neural net; and if affirmative, encoding the block/picture with enhancing using the neural net.Type: GrantFiled: March 29, 2019Date of Patent: September 27, 2022Assignee: Nokia Technologies OyInventors: Miska Hannuksela, Jani Lainema, Francesco Cricri
-
Publication number: 20220303556Abstract: There is disclosed an apparatus, a method and a computer program for video coding. The apparatus comprises a selector configured for selecting a pixel for prediction; a projection definer configured for determining a projection of said pixel to a set of reference pixels; and a prediction definer configured for selecting one or more reference pixels from said set of reference pixels on the basis of said projection, and using said selected one or more reference pixels to obtain a prediction value for said pixel to be predicted.Type: ApplicationFiled: June 9, 2022Publication date: September 22, 2022Applicant: NOKIA TECHNOLOGIES OYInventors: Jani LAINEMA, Kemal UGUR
-
Publication number: 20220295104Abstract: There is disclosed a method comprising obtaining a block of transform coefficients; searching a position of a last non-zero coefficient in a scan order in the block; selecting a secondary transform mode based on the position and encoding first syntax elements indicative of the selected secondary transform mode. A primary transform mode is selected based on the secondary transform mode. Second syntax elements indicative of the selected primary transform mode and third syntax elements defining the transform coefficients within the block are encoded. There is also disclosed a method comprising receiving encoded information related to a block of transform coefficients; decoding an indication of a position of a last non-zero coefficient in a scan order in the block and using the position to determine if an indication of a secondary transform mode is present in the bit stream.Type: ApplicationFiled: September 9, 2020Publication date: September 15, 2022Inventor: Jani LAINEMA
-
Patent number: 11425408Abstract: A system and method for improving the coding efficiency of motion vector information in video coding. According to various embodiments, a list of motion vector predictor candidates is arranged according to predefined rules. Each motion vector also has a reference index associated with it. One of the motion vector candidates is then selected as a predictor based on predefined rules, or the selection is explicitly signaled in the bitstream. The reference index associated with the selected motion vector is used as a reference index for the current block. The reference index is predicted along with the motion vector. Such embodiments can improve the compression efficiency of modern video codecs.Type: GrantFiled: January 13, 2020Date of Patent: August 23, 2022Assignee: NOKIA TECHNOLOGIES OYInventors: Antti Olli Hallapuro, Kemal Ugur, Jani Lainema