Patents Assigned to Deep Render Ltd.
  • Patent number: 11985319
    Abstract: There is disclosed a computer-implemented method for lossy image or video compression, transmission and decoding, the method including the steps of: (i) receiving an input image at a first computer system; (ii) encoding the input image using a first trained neural network, using the first computer system, to produce a latent representation; (iii) quantizing the latent representation using the first computer system to produce a quantized latent; (iv) entropy encoding the quantized latent into a bitstream, using the first computer system; (v) transmitting the bitstream to a second computer system; (vi) the second computer system entropy decoding the bitstream to produce the quantized latent; (vii) the second computer system using a second trained neural network to produce an output image from the quantized latent, wherein the output image is an approximation of the input image. Related computer-implemented methods, systems, computer-implemented training methods and computer program products are disclosed.
    Type: Grant
    Filed: August 4, 2023
    Date of Patent: May 14, 2024
    Assignee: DEEP RENDER LTD.
    Inventors: Chri Besenbruch, Ciro Cursio, Christopher Finlay, Vira Koshkina, Alexander Lytchier, Jan Xu, Arsalan Zafar
  • Patent number: 11936866
    Abstract: A method for lossy video encoding, transmission and decoding, the method comprising the steps of: receiving an input video at a first computer system; encoding an input frame of the input video to produce a latent representation; producing a quantized latent; producing a hyper-latent representation; producing a quantized hyper-latent; entropy encoding the quantized latent; transmitting the entropy encoded quantized latent and the quantized hyper-latent to a second computer system; decoding the quantized hyper-latent to produce a set of context variables, wherein the set of context variables comprise a temporal context variable; entropy decoding the entropy encoded quantized latent using the set of context variables to obtain an output quantized latent; and decoding the output quantized latent to produce an output frame, wherein the output frame is an approximation of the input frame.
    Type: Grant
    Filed: August 30, 2023
    Date of Patent: March 19, 2024
    Assignee: DEEP RENDER LTD.
    Inventors: Chris Finlay, Christian Besenbruch, Jan Xu, Bilal Abbasi, Christian Etmann, Arsalan Zafar, Sebastjan Cizel, Vira Koshkina
  • Patent number: 11893762
    Abstract: A method for lossy image or video encoding, transmission and decoding, the method comprising the steps of: receiving an input image at a first computer system; encoding the input image using a first trained neural network to produce a latent representation; identifying one or more regions of the input image associated with high visual sensitivity; encoding the one or more regions of the input image associated with high visual sensitivity using a second trained neural network to produce one or more region latent representations; performing a quantization process on the latent representation and the one or more region latent representations; transmitting the result of the quantization process to a second computer system; decoding the result of the quantization process to produce an output image, wherein the output image is an approximation of the input image.
    Type: Grant
    Filed: November 15, 2022
    Date of Patent: February 6, 2024
    Assignee: DEEP RENDER LTD.
    Inventors: Thomas Ryder, Alexander Lytchier, Vira Koshkina, Christian Besenbruch, Arsalan Zafar
  • Patent number: 11881003
    Abstract: A computer-implemented method of training an image generative network f? for a set of training images, in which an output image {circumflex over (x)} is generated from an input image x of the set of training images non-losslessly, and in which a proxy network is trained for a gradient intractable perceptual metric that evaluates a quality of an output image {circumflex over (x)} given an input image x, the method of training using a plurality of scales for input images from the set of training images. In an embodiment, a blindspot network b? is trained which generates an output image {tilde over (x)} from an input image x. Related computer systems, computer program products and computer-implemented methods of training are disclosed.
    Type: Grant
    Filed: January 20, 2023
    Date of Patent: January 23, 2024
    Assignee: DEEP RENDER LTD.
    Inventors: Chri Besenbruch, Ciro Cursio, Christopher Finlay, Vira Koshkina, Alexander Lytchier, Jan Xu, Arsalan Zafar
  • Patent number: 11843777
    Abstract: Lossy or lossless compression and transmission, comprising the steps of: (i) receiving an input image; (ii) encoding it to produce a y latent representation; (iii) encoding the y latent representation to produce a z hyperlatent representation; (iv) quantizing the z hyperlatent representation to produce a quantized z hyperlatent representation; (v) entropy encoding the quantized z hyperlatent representation into a first bitstream, (vi) processing the quantized z hyperlatent representation to obtain a location entropy parameter ?y, an entropy scale parameter ?y, and a context matrix Ay of the y latent representation; (vii) processing the y latent representation, the location entropy parameter ?y and the context matrix Ay, to obtain quantized latent residuals; (viii) entropy encoding the quantized latent residuals into a second bitstream; and (ix) transmitting the bitstreams.
    Type: Grant
    Filed: February 3, 2023
    Date of Patent: December 12, 2023
    Assignee: DEEP RENDER LTD.
    Inventors: Chri Besenbruch, Aleksandar Cherganski, Christopher Finlay, Alexander Lytchier, Jonathan Rayner, Tom Ryder, Jan Xu, Arsalan Zafar
  • Patent number: 11677948
    Abstract: There is disclosed a computer-implemented method for lossy image or video compression, transmission and decoding, the method including the steps of: (i) receiving an input image at a first computer system; ({umlaut over (?)}) encoding the input image using a first trained neural network, using the first computer system, to produce a latent representation; (iii) quantizing the latent representation using the first computer system to produce a quantized latent; (iv) entropy encoding the quantized latent into a bitstream, using the first computer system; (v) transmitting the bitstream to a second computer system; (vi) the second computer system entropy decoding the bitstream to produce the quantized latent; (vii) the second computer system using a second trained neural network to produce an output image from the quantized latent, wherein the output image is an approximation of the input image.
    Type: Grant
    Filed: May 10, 2022
    Date of Patent: June 13, 2023
    Assignee: DEEP RENDER LTD.
    Inventors: Chri Besenbruch, Ciro Cursio, Christopher Finlay, Vira Koshkina, Alexander Lytchier, Jan Xu, Arsalan Zafar
  • Patent number: 11606560
    Abstract: Lossy or lossless compression and transmission, comprising the steps of: (i) receiving an input image; (ii) encoding it to produce a y latent representation; (iii) encoding the y latent representation to produce a z hyperlatent representation; (iv) quantizing the z hyperlatent representation to produce a quantized z hyperlatent representation; (v) entropy encoding the quantized z hyperlatent representation into a first bitstream, (vi) processing the quantized z hyperlatent representation to obtain a location entropy parameter ?y, an entropy scale parameter ?y, and a context matrix Ay of the y latent representation; (vii) processing the y latent representation, the location entropy parameter ?y and the context matrix Ay, to obtain quantized latent residuals; (viii) entropy encoding the quantized latent residuals into a second bitstream; and (ix) transmitting the bitstreams.
    Type: Grant
    Filed: May 19, 2022
    Date of Patent: March 14, 2023
    Assignee: DEEP RENDER LTD.
    Inventors: Chri Besenbruch, Aleksandar Cherganski, Christopher Finlay, Alexander Lytchier, Jonathan Rayner, Tom Ryder, Jan Xu, Arsalan Zafar
  • Patent number: 11599972
    Abstract: There is provided a method for lossy image or video encoding and transmission, including the steps of receiving an input image at a first computer system, encoding the input image using a first trained neural network to produce a latent representation, performing a quantization process on the latent representation to produce a quantized latent, and transmitting the quantized latent to a second computer system.
    Type: Grant
    Filed: May 19, 2022
    Date of Patent: March 7, 2023
    Assignee: DEEP RENDER LTD.
    Inventors: Jan Xu, Chri Besenbruch, Arsalan Zafar
  • Patent number: 11558620
    Abstract: Lossy or lossless compression and transmission, comprising the steps of: (i) receiving an input image; (ii) encoding it using an encoder trained neural network, to produce a y latent representation; (iii) encoding the y latent representation using a hyperencoder trained neural network, to produce a z hyperlatent representation; (iv) quantizing the z hyperlatent representation using a predetermined entropy parameter to produce a quantized z hyperlatent representation; (v) entropy encoding the quantized z hyperlatent representation into a first bitstream, using predetermined entropy parameters; (vi) processing the quantized z hyperlatent representation using a hyperdecoder trained neural network to obtain a location entropy parameter ?y, an entropy scale parameter ?y, and a context matrix Ay of the y latent representation; (vii) processing the y latent representation, the location entropy parameter ?y and the context matrix Ay, to obtain quantized latent residuals; (viii) entropy encoding the quantized latent r
    Type: Grant
    Filed: May 10, 2022
    Date of Patent: January 17, 2023
    Assignee: DEEP RENDER LTD.
    Inventors: Chri Besenbruch, Aleksandar Cherganski, Christopher Finlay, Alexander Lytchier, Jonathan Rayner, Tom Ryder, Jan Xu, Arsalan Zafar
  • Patent number: 11544881
    Abstract: A method for lossy image or video encoding, transmission and decoding, the method comprising the steps of: receiving an input image at a first computer system; encoding the first input training image using a first trained neural network to produce a latent representation; performing a quantization process on the latent representation to produce a quantized latent; entropy encoding the quantized latent using a probability distribution, wherein the probability distribution is defined using a tensor network; transmitting the entropy encoded quantized latent to a second computer system; entropy decoding the entropy encoded quantized latent using the probability distribution to retrieve the quantized latent; and decoding the quantized latent using a second trained neural network to produce an output image, wherein the output image is an approximation of the input training image.
    Type: Grant
    Filed: May 19, 2022
    Date of Patent: January 3, 2023
    Assignee: DEEP RENDER LTD.
    Inventors: Chris Finlay, Jonathan Rayner, Chri Besenbruch, Arsalan Zafar
  • Patent number: 11532104
    Abstract: A method for lossy image or video encoding, transmission and decoding, the method comprising the steps of: receiving an input image at a first computer system; encoding the input image using a first trained neural network to produce a latent representation; identifying one or more regions of the input image associated with high visual sensitivity; encoding the one or more regions of the input image associated with high visual sensitivity using a second trained neural network to produce one or more region latent representations; performing a quantization process on the latent representation and the one or more region latent representations; transmitting the result of the quantization process to a second computer system; decoding the result of the quantization process to produce an output image, wherein the output image is an approximation of the input image.
    Type: Grant
    Filed: May 19, 2022
    Date of Patent: December 20, 2022
    Assignee: DEEP RENDER LTD.
    Inventors: Thomas Ryder, Alexander Lytchier, Vira Koshkina, Christian Besenbruch, Arsalan Zafar
  • Patent number: 10489936
    Abstract: A system and method for lossy image and video compression that utilizes a metanetwork to generate a set of hyperparameters necessary for an image encoding network to reconstruct the desired image from a given noise image.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: November 26, 2019
    Assignee: Deep Render Ltd.
    Inventors: Arsalan Ali Zafar, Christian Lars Besenbruch
  • Patent number: 10373300
    Abstract: A system and method for lossy image and video compression and transmission that utilizes a neural network as a function to map a known noise image to a desired or target image, allowing the transfer only of hyperparameters of the function instead of a compressed version of the image itself. This allows the recreation of a high-quality approximation of the desired image by any system receiving the hyperparameters, provided that the receiving system possesses the same noise image and a similar neural network. The amount of data required to transfer an image of a given quality is dramatically reduced versus existing image compression technology. Being that video is simply a series of images, the application of this image compression system and method allows the transfer of video content at rates greater than existing technologies in relation to the same image quality.
    Type: Grant
    Filed: April 29, 2019
    Date of Patent: August 6, 2019
    Assignee: Deep Render Ltd.
    Inventors: Christian Lars Besenbruch, Arsalan Ali Zafar