Patents by Inventor Robert David Bishop

Robert David Bishop has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11528492
    Abstract: A method for developing an enhancement model for low-quality visual data, the method comprising the steps of receiving one or more sections of higher-quality visual data; and training a hierarchical algorithm. The hierarchical algorithm is operable to increase the quality of one or more sections of lower-quality visual data so as to substantially reproduce the one or more sections of higher-quality visual data. The hierarchical algorithm is then outputted.
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: December 13, 2022
    Assignee: Twitter, Inc.
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 11386599
    Abstract: A method for developing visual data using source data, target data, and a hierarchical algorithm. According to a first aspect, there is provided a method for developing visual data from source data, target data and using a hierarchical algorithm, the method comprising the steps of: determining an alignment between the target data and the source data; and producing the visual data by transferring one or more features of the source data onto one or more features of the target data; wherein, the visual data is produced after the step of determining the alignment between the target data and the source data; and wherein the visual data is produced using the hierarchical algorithm.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: July 12, 2022
    Assignee: Twitter, Inc.
    Inventors: Lucas Theis, Zehan Wang, Robert David Bishop
  • Patent number: 11234006
    Abstract: Methods and systems for optimising the quality of visual data. Specifically, methods and systems for preserving visual information during compression and decompression. An example method for optimising visual data includes using a pre-processing neural network to optimise visual data prior to encoding the visual data in visual data processing; and using a post-processing neural network to enhance visual data following decoding visual data in visual data processing.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: January 25, 2022
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Ferenc Huszar, Lucas Theis
  • Patent number: 11109051
    Abstract: The present disclosure relates to the use of hierarchical algorithms to temporally interpolate enhanced reference pictures for use in video encoding and decoding. According to a first aspect, there is provided a method of generating enhanced reference pictures in a video encoding and/or decoding process, the method comprising: receiving one or more known reference elements of video data from a reference picture buffer; generating, using one or more hierarchical algorithms, one or more additional reference elements of video data from the one or more known reference elements of video data; and outputting the one or more additional reference elements of video data; wherein the generating the one or more additional reference elements of video data from the one or more known reference elements of video data comprises the use of temporal interpolation.
    Type: Grant
    Filed: December 27, 2017
    Date of Patent: August 31, 2021
    Assignee: Magic Pony Technology Limited
    Inventors: Sebastiaan Van Leuven, Jose Caballero, Zehan Wang, Robert David Bishop
  • Patent number: 10909743
    Abstract: Generating texture maps for use in rendering visual output. According to a first aspect, there is provided a method for generating textures for use in rendering visual output, the method comprising the steps of: generating, using a first hierarchical algorithm, a first texture from one or more sets of initialisation data; and selectively refining the first texture, using one or more further hierarchical algorithms, to generate one or more further textures from at least a section of the first texture and one or more sets of further initialisation data; wherein at least a section of each of the one or more further textures differs from the first texture.
    Type: Grant
    Filed: December 28, 2017
    Date of Patent: February 2, 2021
    Assignee: Magic Pony Technology Limited
    Inventors: Lucas Theis, Zehan Wang, Robert David Bishop
  • Patent number: 10904541
    Abstract: A method for increasing the quality of a section of visual data communicated over a network from a first node to a second node, the method at the second node including receiving a lower-quality visual data via a network, receiving a corresponding reference to an algorithm operable to increase a quality of the lower-quality visual data, the algorithm selected based on a higher-quality visual data from which the lower-quality visual data was generated, and using the algorithm to increase the quality of the lower-quality visual data to recreate the higher-quality visual data.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: January 26, 2021
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10887613
    Abstract: A method for enhancing one or more sections of lower-quality visual data using a hierarchical algorithm, the method comprising receiving one or more sections of lower-quality visual data. The one or more sections of lower-quality visual data are enhanced to one or more sections of higher-quality visual data using the hierarchical algorithm. Additionally, at least the first step of the hierarchical algorithm is performed in a lower-quality domain; and wherein the hierarchical algorithm operates in both a higher-quality domain and the lower-quality domain.
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: January 5, 2021
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10825138
    Abstract: Systems and methods for developing improved-fidelity visual data using fidelity data and using a hierarchical algorithm are provided. An example method includes receiving at least a plurality of neighbouring sections of visual data, selecting a plurality of input sections from the received plurality of neighbouring sections of visual data, extracting features from the plurality of input sections of visual data, and producing the improved-fidelity visual data by applying the fidelity data to the extracted features.
    Type: Grant
    Filed: December 28, 2017
    Date of Patent: November 3, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Lucas Theis
  • Patent number: 10791333
    Abstract: The present disclosure relates to encoding visual data comprising a plurality of layers using one or more hierarchical algorithms. According to an aspect, there is provided a method of encoding visual data using a plurality of layers wherein each layer encodes a different representation, and wherein one or more of the plurality of layers comprises one or more hierarchical algorithms, the method comprising the steps of: extracting one or more samples within each of the plurality of layers; and processing within each layer the one or more samples extracted in the layer; wherein in at least one of the plurality of layers the step of processing comprises applying the one or more hierarchical algorithms to the samples extracted in the layer in relation to any inter-layer prediction; and wherein the step of processing reduces a predetermined mathematical distortion between samples of a first layer and samples of a second layer.
    Type: Grant
    Filed: December 27, 2017
    Date of Patent: September 29, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Sebastiaan Van Leuven, Zehan Wang, Robert David Bishop
  • Publication number: 20200280730
    Abstract: Methods and systems for optimising the quality of visual data. Specifically, methods and systems for preserving visual information during compression and decompression. An example method for optimising visual data includes using a pre-processing neural network to optimise visual data prior to encoding the visual data in visual data processing; and using a post-processing neural network to enhance visual data following decoding visual data in visual data processing.
    Type: Application
    Filed: May 13, 2020
    Publication date: September 3, 2020
    Inventors: Zehan Wang, Robert David Bishop, Ferenc Huszar, Lucas Theis
  • Publication number: 20200273224
    Abstract: A method for developing visual data using source data, target data, and a hierarchical algorithm. According to a first aspect, there is provided a method for developing visual data from source data, target data and using a hierarchical algorithm, the method comprising the steps of: determining an alignment between the target data and the source data; and producing the visual data by transferring one or more features of the source data onto one or more features of the target data; wherein, the visual data is produced after the step of determining the alignment between the target data and the source data; and wherein the visual data is produced using the hierarchical algorithm.
    Type: Application
    Filed: May 13, 2020
    Publication date: August 27, 2020
    Inventors: Lucas Theis, Zehan Wang, Robert David Bishop
  • Patent number: 10699456
    Abstract: A method for developing visual data using source data, target data, and a hierarchical algorithm. According to a first aspect, there is provided a method for developing visual data from source data, target data and using a hierarchical algorithm, the method comprising the steps of: determining an alignment between the target data and the source data; and producing the visual data by transferring one or more features of the source data onto one or more features of the target data; wherein, the visual data is produced after the step of determining the alignment between the target data and the source data; and wherein the visual data is produced using the hierarchical algorithm.
    Type: Grant
    Filed: December 28, 2017
    Date of Patent: June 30, 2020
    Assignee: MAGIC PONY TECHNOLOGY LIMITED
    Inventors: Lucas Theis, Zehan Wang, Robert David Bishop
  • Patent number: 10692185
    Abstract: A method for training an algorithm to process at least a section of received visual data using a training dataset and reference dataset. The method comprises an iterative method with iterations comprising: generating a set of training data using the algorithm; comparing one or more characteristics of the training data to one or more characteristics of at least a section of the reference dataset; and modifying one or more parameters of the algorithm to optimise processed visual data based on the comparison between the characteristic of the training data and the characteristic of the reference dataset. The algorithm may output the processed visual data with the same content as the at least a section of received visual data. Some aspects and/or implementations provide for improved super-resolution of lower quality images to produce super-resolution images with improved characteristics (e.g. less blur, less undesired smoothing) compared to other super-resolution techniques.
    Type: Grant
    Filed: December 28, 2017
    Date of Patent: June 23, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Wenzhe Shi, Ferenc Huszar, Robert David Bishop
  • Patent number: 10685264
    Abstract: The present disclosure relates to a method for processing input visual data using a generated algorithm based upon input visual data and the output of a calculated energy function. According to a first aspect of the disclosure, there is provided a method for enhancing input visual data using an algorithm, the method comprising evaluating gradients of the output of an energy function with respect to the input visual data; using the gradient output to enhance the input visual data; and outputting the enhanced visual data.
    Type: Grant
    Filed: December 27, 2017
    Date of Patent: June 16, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Ferenc Huszar, Robert David Bishop, Zehan Wang
  • Patent number: 10681361
    Abstract: Methods and systems for optimising the quality of visual data. Specifically, methods and systems for preserving visual information during compression and decompression. An example method for optimising visual data includes using a pre-processing hierarchical algorithm to optimise visual data prior to encoding the visual data in visual data processing; and using a post-processing hierarchical algorithm to enhance visual data following decoding visual data in visual data processing.
    Type: Grant
    Filed: December 27, 2017
    Date of Patent: June 9, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Ferenc Huszar, Lucas Theis
  • Patent number: 10666962
    Abstract: Disclosed is method for training a plurality of visual processing algorithms for processing visual data. The method includes using a pre-processing hierarchical algorithm to process the visual data prior to encoding the visual data in visual data processing, and using a post-processing hierarchical algorithm to further process the visual data following decoding visual data in visual data processing. The encoding and decoding are performed with respect to a predetermined visual data codec and may be content specific.
    Type: Grant
    Filed: September 18, 2017
    Date of Patent: May 26, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Ferenc Huszar, Lucas Theis
  • Patent number: 10630996
    Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method including receiving at least a plurality of neighbouring sections of lower-quality visual data. A plurality of input sections from the received plurality of neighbouring sections of lower quality visual data are selected and features are extracted from those plurality of input sections of lower-quality visual data. A target section based on the extracted features from the plurality of input sections of lower-quality visual data is then enhanced.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: April 21, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10623756
    Abstract: A method for enhancing lower-quality visual data using hierarchical algorithms, the method comprising the steps of: receiving one or more sections of lower-quality visual data; applying a hierarchical algorithm to the one or more sections of lower-quality visual data to enhance the one or more sections of lower-quality visual data to one or more sections of higher-quality visual data, wherein the hierarchical algorithm was developed using a learned approach; and outputting the one or more sections of higher-quality visual data.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: April 14, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10602163
    Abstract: The present disclosure relates to analysing input data, prior to encoding, using one or more hierarchical algorithms. According to a first aspect, there is provided a method for producing output data using one or more input data and one or more hierarchical algorithms, comprising the steps of applying the hierarchical algorithm to the one or more input data; and producing output data to be used by an encoder; wherein one of the one or more input data is uncompressed; and wherein the output data is used to modify a decision making process associated with the encoder.
    Type: Grant
    Filed: December 28, 2017
    Date of Patent: March 24, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Sebastiaan Van Leuven, Zehan Wang, Robert David Bishop
  • Patent number: 10582205
    Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprises receiving at least one section of lower-quality visual data; and extracting a subset of features, from the at least one section of lower-quality visual data. A plurality of layers of reduced-dimension visual data from the extracted features are formed and enhanced to form at least one section of higher-quality visual data. The at least one section of higher-quality visual data corresponds to the at least one section of lower-quality visual data received.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: March 3, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz