Patents by Inventor Jyrki Alakuijala

Jyrki Alakuijala has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11968406
    Abstract: An image encoder includes a processor and a memory. The memory includes instructions configured to cause the processor to perform operations. In one example implementation, the operations may include determining whether a dictionary item is available for replacing a block of an image being encoded, the determining based on a hierarchical lookup mechanism, and encoding the image along with reference information of the dictionary item in response to determining that the dictionary item is available. In one more example implementation, the operations may include performing principal component analysis (PCA) on a block to generate a corresponding projected block, the block being associated with a group of images, comparing the projected block with a corresponding threshold, descending the block recursively based on the threshold until a condition is satisfied, and identifying a left over block as a cluster upon satisfying of the condition.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: April 23, 2024
    Assignee: Google LLC
    Inventors: Krzysztof Potempa, Jyrki Alakuijala, Robert Obryk
  • Patent number: 11900222
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing a machine learning model that is trained to perform a machine learning task. In one aspect, a method comprises receiving a request to train a machine learning model on a set of training examples; determining a set of one or more meta-data values characterizing the set of training examples; using a mapping function to map the set of meta-data values characterizing the set of training examples to data identifying a particular machine learning model architecture; selecting, using the particular machine learning model architecture, a final machine learning model architecture for performing the machine learning task; and training a machine learning model having the final machine learning model architecture on the set of training examples.
    Type: Grant
    Filed: March 15, 2019
    Date of Patent: February 13, 2024
    Assignee: Google LLC
    Inventors: Jyrki A. Alakuijala, Quentin Lascombes de Laroussilhe, Andrey Khorlin, Jeremiah Joseph Harmsen, Andrea Gesmundo
  • Patent number: 11849113
    Abstract: Artificial image generation may include obtaining a source image, identifying quantization information from the source image, wherein identifying the quantization information includes identifying multiresolution quantization interval information from the source image, generating a restoration filtered image by restoration filtering the source image, generating a constrained restoration filtered image by constraining the restoration filtered image based on the quantization information, obtaining an unconstrained artificial image based on the constrained restoration filtered image and a generative artificial neural network obtained using a generative adversarial network, obtaining the artificial image by constraining the unconstrained artificial image based on the quantization information, and outputting the artificial image.
    Type: Grant
    Filed: October 20, 2021
    Date of Patent: December 19, 2023
    Assignee: GOOGLE LLC
    Inventors: Jyrki Alakuijala, George Toderici
  • Patent number: 11755287
    Abstract: A method for generating random numbers includes initializing a pseudo-random number generator (PRNG) having a state of 2048 bits comprising inner bits and outer bits, the inner bits comprising the first 128 bits of the 2048 bits and the outer bits comprising the remaining bits of the 2048 bits. The method also includes retrieving AES round keys from a key source, and for a threshold number of times, executing a round function using the AES round keys by XOR'ing odd-numbered branches of a Feistel network having 16 branches of 128 bits with a function of corresponding even-numbered neighbor branches of the Feistel network, and shuffling each branch of 128 bits into a prescribed order. The method also includes executing an XOR of the inner bits of the permuted state with the inner bits of a previous state.
    Type: Grant
    Filed: August 24, 2022
    Date of Patent: September 12, 2023
    Assignee: Google LLC
    Inventors: Jan Wassenberg, Robert Obryk, Jyrki Alakuijala, Emmanuel Mogenet
  • Publication number: 20230281193
    Abstract: Systems, methods, and computer readable media related to generating query variants for a submitted query. In many implementations, the query variants are generated utilizing a generative model. A generative model is productive, in that it can be utilized to actively generate a variant of a query based on application of tokens of the query to the generative model, and optionally based on application of additional input features to the generative model.
    Type: Application
    Filed: May 12, 2023
    Publication date: September 7, 2023
    Inventors: Jyrki Alakuijala, Christian Buck, Jannis Bulian, Massimiliano Ciaramita, Wojciech Gajewski, Andrea Gesmundo, Neil Houlsby, Wei Wang
  • Patent number: 11734568
    Abstract: The present disclosure provides systems and methods for modification (e.g., pruning, compression, quantization, etc.) of artificial neural networks based on estimations of the utility of network connections (also known as “edges”). In particular, the present disclosure provides novel techniques for estimating the utility of one or more edges of a neural network in a fashion that requires far less expenditure of resources than calculation of the actual utility. Based on these estimated edge utilities, a computing system can make intelligent decisions regarding network pruning, network quantization, or other modifications to a neural network. In particular, these modifications can reduce resource requirements associated with the neural network. By making these decisions with knowledge of and based on the utility of various edges, this reduction in resource requirements can be achieved with only a minimal, if any, degradation of network performance (e.g., prediction accuracy).
    Type: Grant
    Filed: February 13, 2019
    Date of Patent: August 22, 2023
    Assignee: GOOGLE LLC
    Inventors: Jyrki Alakuijala, Ruud van Asseldonk, Robert Obryk, Krzysztof Potempa
  • Patent number: 11695919
    Abstract: An apparatus includes a processor that is configured to select a palette entry in the palette for coding a value of a pixel of the image block; obtain respective palette indexes of neighboring pixels of the pixel; select, using the respective palette indexes, an entropy code for coding an index of the palette entry; and code the palette entry using the entropy code. A method includes obtaining respective palette indexes of neighboring pixels of a pixel of the image block; selecting an entropy code using the respective palette indexes; decoding, from a encoded bitstream, an index of a palette entry; and setting a value of the pixel using the palette entry.
    Type: Grant
    Filed: November 10, 2020
    Date of Patent: July 4, 2023
    Assignee: GOOGLE LLC
    Inventors: Jyrki Alakuijala, Alexander Rhatushnyak
  • Patent number: 11663201
    Abstract: Systems, methods, and computer readable media related to generating query variants for a submitted query. In many implementations, the query variants are generated utilizing a generative model. A generative model is productive, in that it can be utilized to actively generate a variant of a query based on application of tokens of the query to the generative model, and optionally based on application of additional input features to the generative model.
    Type: Grant
    Filed: April 27, 2018
    Date of Patent: May 30, 2023
    Assignee: GOOGLE LLC
    Inventors: Jyrki Alakuijala, Christian Buck, Jannis Bulian, Massimiliano Ciaramita, Wojciech Gajewski, Andrea Gesmundo, Neil Houlsby, Wei Wang
  • Publication number: 20230147376
    Abstract: Methods are provided for improving the quality and compression factor of compressed images. The methods include determining frequency-band-specific quantization levels on a block-by-block level. This results in an adaptive dead zone, allowing certain blocks to be represented by fewer nonzero elements while other blocks are represented by more nonzero elements. Accordingly, the quality of the encoded image is improved while maintaining or improving the compression ratio. The adaptive quantization level is determined by comparing a post-quantization energy level to a threshold energy criterion for each frequency band within a block. Where the energy threshold criterion is not satisfied via these methods, additional methods can be applied to improve the image quality.
    Type: Application
    Filed: October 14, 2019
    Publication date: May 11, 2023
    Inventors: Jyrki Alakuijala, Luca Versari
  • Publication number: 20230141888
    Abstract: A method for partitioning a block of an image to reduce quantization artifacts includes estimating an expected entropy of the block; partitioning the block into sub-blocks, where each sub-block having a size of a smallest possible partition size; calculating respective amounts of visual masking for the sub-blocks; selecting, as a visual masking characteristic of the block, a highest visual masking value of the respective amounts of visual masking for the sub-blocks; combining the visual masking characteristic of the block and the expected entropy of the block to obtain a splitting indicator value; and determining whether to split the block based on the splitting indicator.
    Type: Application
    Filed: April 8, 2020
    Publication date: May 11, 2023
    Inventors: Jyrki Alakuijala, Luca Versari
  • Publication number: 20230016253
    Abstract: The loss of image quality during compression is controlled using a sequence of quality control metrics. The sequence of quality control metrics is selected for quantizing transform coefficients within an area of the image based on an error level definition. Candidate bit costs are then determined by quantizing the transform coefficients according to the error level definition or a modified error level and the sequence of quality control metrics. Where the candidate bit cost resulting from using the modified error level is lower than the candidate bit cost resulting from using the error level definition, the transform coefficients are quantized according to the modified error level and the sequence of quality control metrics. Otherwise, the transform coefficients are quantized based on the error level definition and according to the sequence of quality control metrics.
    Type: Application
    Filed: September 29, 2022
    Publication date: January 19, 2023
    Inventors: Jyrki Alakuijala, Robert Obryk, Evgenii Kliuchnikov, Zoltan Szabadka, Jan Wassenberg, Minttu Alakuijala, Lode Vandevenne
  • Publication number: 20220405058
    Abstract: A method for generating random numbers includes initializing a pseudo-random number generator (PRNG) having a state of 2048 bits comprising inner bits and outer bits, the inner bits comprising the first 128 bits of the 2048 bits and the outer bits comprising the remaining bits of the 2048 bits. The method also includes retrieving AES round keys from a key source, and for a threshold number of times, executing a round function using the AES round keys by XOR'ing odd-numbered branches of a Feistel network having 16 branches of 128 bits with a function of corresponding even-numbered neighbor branches of the Feistel network, and shuffling each branch of 128 bits into a prescribed order. The method also includes executing an XOR of the inner bits of the permuted state with the inner bits of a previous state.
    Type: Application
    Filed: August 24, 2022
    Publication date: December 22, 2022
    Applicant: Google LLC
    Inventors: Jan Wassenberg, Robert Obryk, Jyrki Alakuijala, Emmanuel Mogenet
  • Patent number: 11531932
    Abstract: The present disclosure provides systems and methods for compressing and/or distributing machine learning models. In one example, a computer-implemented method is provided to compress machine-learned models, which includes obtaining, by one or more computing devices, a machine-learned model. The method includes selecting, by the one or more computing devices, a weight to be quantized and quantizing, by the one or more computing devices, the weight. The method includes propagating, by the one or more computing devices, at least a part of a quantization error to one or more non-quantized weights and quantizing, by the one or more computing devices, one or more of the non-quantized weights. The method includes providing, by the one or more computing devices, a quantized machine-learned model.
    Type: Grant
    Filed: July 6, 2017
    Date of Patent: December 20, 2022
    Assignee: GOOGLE LLC
    Inventors: Jyrki Alakuijala, Robert Obryk
  • Patent number: 11463733
    Abstract: The loss of image quality during compression is controlled using a sequence of quality control metrics. The sequence of quality control metrics is selected for quantizing transform coefficients within an area of the image based on an error level definition. Candidate bit costs are then determined by quantizing the transform coefficients according to the error level definition or a modified error level and the sequence of quality control metrics. Where the candidate bit cost resulting from using the modified error level is lower than the candidate bit cost resulting from using the error level definition, the transform coefficients are quantized according to the modified error level and the sequence of quality control metrics. Otherwise, the transform coefficients are quantized based on the error level definition and according to the sequence of quality control metrics.
    Type: Grant
    Filed: February 15, 2019
    Date of Patent: October 4, 2022
    Assignee: GOOGLE LLC
    Inventors: Jyrki Alakuijala, Robert Obryk, Evgenii Kliuchnikov, Zoltan Szabadka, Jan Wassenberg, Minttu Alakuijala, Lode Vandevenne
  • Patent number: 11457239
    Abstract: Video decoding may include transform coefficient continuity smoothing, which may include coefficient continuity smoothing, defined correlation coefficient smoothing, pixel range projection, and luminance correlated chrominance resampling. Coefficient continuity smoothing may include obtaining encoded block data from the encoded bitstream, the encoded block data corresponding to a current block from the reconstructed frame, and generating reconstructed block data for the current block based on the encoded block data using transform coefficient continuity smoothing.
    Type: Grant
    Filed: November 9, 2017
    Date of Patent: September 27, 2022
    Assignee: GOOGLE LLC
    Inventors: Jyrki Alakuijala, Zoltan Szabadka
  • Patent number: 11449311
    Abstract: A method for generating random numbers includes initializing a pseudo-random number generator (PRNG) having a state of 2048 bits comprising inner bits and outer bits, the inner bits comprising the first 128 bits of the 2048 bits and the outer bits comprising the remaining bits of the 2048 bits. The method also includes retrieving AES round keys from a key source, and for a threshold number of times, executing a round function using the AES round keys by XOR'ing odd-numbered branches of a Feistel network having 16 branches of 128 bits with a function of corresponding even-numbered neighbor branches of the Feistel network, and shuffling each branch of 128 bits into a prescribed order. The method also includes executing an XOR of the inner bits of the permuted state with the inner bits of a previous state.
    Type: Grant
    Filed: November 7, 2017
    Date of Patent: September 20, 2022
    Assignee: Google LLC
    Inventors: Jan Wassenberg, Robert Obryk, Jyrki Alakuijala, Emmanuel Mogenet
  • Publication number: 20220046242
    Abstract: Artificial image generation may include obtaining a source image, identifying quantization information from the source image, wherein identifying the quantization information includes identifying multiresolution quantization interval information from the source image, generating a restoration filtered image by restoration filtering the source image, generating a constrained restoration filtered image by constraining the restoration filtered image based on the quantization information, obtaining an unconstrained artificial image based on the constrained restoration filtered image and a generative artificial neural network obtained using a generative adversarial network, obtaining the artificial image by constraining the unconstrained artificial image based on the quantization information, and outputting the artificial image.
    Type: Application
    Filed: October 20, 2021
    Publication date: February 10, 2022
    Inventors: Jyrki Alakuijala, George Toderici
  • Patent number: 11234022
    Abstract: A method includes obtaining respective filtered pixels for pixels of a reconstructed image; and obtaining an edge-preserved image using the respective filtered pixels. Obtaining the respective filtered pixels includes, for each pixel of the reconstructed image, obtaining a respective filtered pixel by selecting a pixel patch including the pixel and first neighboring pixels of the pixel that are at relative neighboring locations with respect to the pixel; calculating respective weights for the first neighboring pixels; and filtering the pixel using the respective weights of the first neighboring pixels and the neighboring pixels to obtain the respective filtered pixel.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: January 25, 2022
    Assignee: GOOGLE LLC
    Inventors: Jan Wassenberg, Jyrki Alakuijala, Sami Boukortt
  • Patent number: 11212527
    Abstract: An image block is coded using entropy-inspired directional filtering. During encoding, intensity differences are determined for at least some pixels of an image block based on neighboring pixels of respective ones of the at least some pixels. Angles are estimated for each of those pixels based on the intensity differences. A main filtering direction of the image block is then determined based on the estimated angles. The image block is filtered according to the main filtering direction to remove artifacts along oblique edges associated with the image block. The filtered image block is then encoded to an encoded image. During decoding, an angular map indicating angles estimated for pixels of an encoded image block is received and used to determine the main filtering direction of the image block. The image block can then be filtered according to the main filtering direction and then output for display or storage.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: December 28, 2021
    Assignee: GOOGLE LLC
    Inventors: Jyrki Alakuijala, Lode Vandevenne, Thomas Fischbacher
  • Patent number: 11166022
    Abstract: Artificial image generation may include obtaining a source image, identifying quantization information from the source image, wherein identifying the quantization information includes identifying multiresolution quantization interval information from the source image, generating a restoration filtered image by restoration filtering the source image, generating a constrained restoration filtered image by constraining the restoration filtered image based on the quantization information, obtaining an unconstrained artificial image based on the constrained restoration filtered image and a generative artificial neural network obtained using a generative adversarial network, obtaining the artificial image by constraining the unconstrained artificial image based on the quantization information, and outputting the artificial image.
    Type: Grant
    Filed: June 4, 2019
    Date of Patent: November 2, 2021
    Assignee: GOOGLE LLC
    Inventors: Jyrki Alakuijala, George Toderici