Patents by Inventor Jose Caballero

Jose Caballero has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11528492
    Abstract: A method for developing an enhancement model for low-quality visual data, the method comprising the steps of receiving one or more sections of higher-quality visual data; and training a hierarchical algorithm. The hierarchical algorithm is operable to increase the quality of one or more sections of lower-quality visual data so as to substantially reproduce the one or more sections of higher-quality visual data. The hierarchical algorithm is then outputted.
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: December 13, 2022
    Assignee: Twitter, Inc.
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 11308361
    Abstract: An example system includes a processor and a memory. The system performs sub-pixel convolution that is free of checkerboard artifacts. In one example implementation, the system may execute a method that includes initializing one or more parameters of a sub-kernel of a kernel and copying the one or more parameters of the sub-kernel to other sub-kernels of the kernel. The method may further include performing convolution of an input image with the sub-kernels of the kernel and generating a plurality of first output images. A second output image is then generated based on the plurality of first output images.
    Type: Grant
    Filed: July 5, 2018
    Date of Patent: April 19, 2022
    Assignee: Twitter, Inc.
    Inventors: Andrew Aitken, Christian Ledig, Lucas Theis, Jose Caballero, Zehan Wang, Wenzhe Shi
  • Patent number: 11122238
    Abstract: A method includes selecting two or more frames from a plurality of frames of a video, downscaling the two or more frames, estimating a flow data based on an optical flow associated with the downscaled two or more frames, upscaling the flow data, generating a refined flow data based on the upscaled flow data and the downscaled two or more frames, upscaling the refined flow data, and synthesizing an image based on the upscaled refined flow data and the two or more frames.
    Type: Grant
    Filed: November 7, 2018
    Date of Patent: September 14, 2021
    Assignee: Twitter, Inc.
    Inventors: Joost van Amersfoort, Wenzhe Shi, Jose Caballero, Alfredo Alejandro Acosta Diaz, Francisco Massa, Johannes Totz, Zehan Wang
  • Patent number: 11109051
    Abstract: The present disclosure relates to the use of hierarchical algorithms to temporally interpolate enhanced reference pictures for use in video encoding and decoding. According to a first aspect, there is provided a method of generating enhanced reference pictures in a video encoding and/or decoding process, the method comprising: receiving one or more known reference elements of video data from a reference picture buffer; generating, using one or more hierarchical algorithms, one or more additional reference elements of video data from the one or more known reference elements of video data; and outputting the one or more additional reference elements of video data; wherein the generating the one or more additional reference elements of video data from the one or more known reference elements of video data comprises the use of temporal interpolation.
    Type: Grant
    Filed: December 27, 2017
    Date of Patent: August 31, 2021
    Assignee: Magic Pony Technology Limited
    Inventors: Sebastiaan Van Leuven, Jose Caballero, Zehan Wang, Robert David Bishop
  • Patent number: 10904541
    Abstract: A method for increasing the quality of a section of visual data communicated over a network from a first node to a second node, the method at the second node including receiving a lower-quality visual data via a network, receiving a corresponding reference to an algorithm operable to increase a quality of the lower-quality visual data, the algorithm selected based on a higher-quality visual data from which the lower-quality visual data was generated, and using the algorithm to increase the quality of the lower-quality visual data to recreate the higher-quality visual data.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: January 26, 2021
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10887613
    Abstract: A method for enhancing one or more sections of lower-quality visual data using a hierarchical algorithm, the method comprising receiving one or more sections of lower-quality visual data. The one or more sections of lower-quality visual data are enhanced to one or more sections of higher-quality visual data using the hierarchical algorithm. Additionally, at least the first step of the hierarchical algorithm is performed in a lower-quality domain; and wherein the hierarchical algorithm operates in both a higher-quality domain and the lower-quality domain.
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: January 5, 2021
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10701394
    Abstract: A method includes selecting a plurality of low-resolution frames associated with a video, performing a first motion estimation between a first frame and a second frame, performing a second motion estimation between a third frame and the second frame, generating a high-resolution frame representing the second frame based on the first motion estimation, the second motion estimation and the second frame using a sub-pixel convolutional neural network.
    Type: Grant
    Filed: November 10, 2017
    Date of Patent: June 30, 2020
    Assignee: Twitter, Inc.
    Inventors: Jose Caballero, Christian Ledig, Andrew Aitken, Alfredo Alejandro Acosta Diaz, Lucas Theis, Ferenc Huszar, Johannes Totz, Zehan Wang, Wenzhe Shi
  • Patent number: 10630996
    Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method including receiving at least a plurality of neighbouring sections of lower-quality visual data. A plurality of input sections from the received plurality of neighbouring sections of lower quality visual data are selected and features are extracted from those plurality of input sections of lower-quality visual data. A target section based on the extracted features from the plurality of input sections of lower-quality visual data is then enhanced.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: April 21, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10623756
    Abstract: A method for enhancing lower-quality visual data using hierarchical algorithms, the method comprising the steps of: receiving one or more sections of lower-quality visual data; applying a hierarchical algorithm to the one or more sections of lower-quality visual data to enhance the one or more sections of lower-quality visual data to one or more sections of higher-quality visual data, wherein the hierarchical algorithm was developed using a learned approach; and outputting the one or more sections of higher-quality visual data.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: April 14, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Publication number: 20200073485
    Abstract: Systems and methods for emoji prediction and visual sentiment analysis are provided. An example system includes a computer-implemented method. The method may be used to predict emoji or analyze sentiment for an input image. An example method includes the step of receiving an image. The example method further includes the steps of generating an emoji embedding for the image and generating a sentiment label for the image using the emoji embedding. The emoji embedding may be generated using a machine learning model.
    Type: Application
    Filed: September 5, 2019
    Publication date: March 5, 2020
    Inventors: Ziad Al-Halah, Andrew P. Aitken, Wenzhe Shi, Jose Caballero
  • Patent number: 10582205
    Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprises receiving at least one section of lower-quality visual data; and extracting a subset of features, from the at least one section of lower-quality visual data. A plurality of layers of reduced-dimension visual data from the extracted features are formed and enhanced to form at least one section of higher-quality visual data. The at least one section of higher-quality visual data corresponds to the at least one section of lower-quality visual data received.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: March 3, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10547858
    Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprising receiving at least a plurality of neighbouring sections of lower-quality visual data. A plurality of input sections from the received plurality of neighbouring sections of lower quality visual data are selected and features are extracted from those plurality of input sections of lower-quality visual data. A target section based on the extracted features from the plurality of input sections of lower-quality visual data is then enhanced.
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: January 28, 2020
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10523955
    Abstract: A method for enhancing at least a section of lower-quality visual data, the method comprising at least a section of the lower-quality visual data being received. A hierarchical algorithm is then selected from a plurality of hierarchical algorithms, wherein the step of selection is based on a predetermined metric and wherein the hierarchical algorithms were developed using a learned approach and at least one of the hierarchical algorithms is operable to increase the quality of the lower-quality visual data. The selected hierarchical algorithm is then used to increase the quality of the lower-quality visual data to create a higher-quality visual data.
    Type: Grant
    Filed: August 17, 2017
    Date of Patent: December 31, 2019
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10516890
    Abstract: A method for training learned hierarchical algorithms, the method comprising the steps of receiving input data and generating metrics from the input data. At least one hierarchical algorithm is then selected from a plurality of predetermined hierarchical algorithms based on comparing the generated metrics from the input data and like metrics for each of the plurality of predetermined hierarchical algorithms. The selected hierarchical algorithm is developed based on the input data and the developed hierarchical algorithm is outputted.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: December 24, 2019
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10499069
    Abstract: A method for enhancing visual data when communicating visual data over a network from a first node to a second node. The method at the first node comprises developing at least one modified hierarchical algorithm from a known hierarchical algorithm operable to substantially recreate at least one section of higher-quality visual data. References to one or more known hierarchical algorithms from which the modified hierarchical algorithms were developed are transmitted to the second node along with one or more modifications to the one or more known hierarchical algorithms operable to reproduce the one or more modified hierarchical algorithms from the known hierarchical algorithms. The second node is able to recreate substantially the higher-quality video using the modified hierarchical algorithm.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: December 3, 2019
    Assignee: Magic Pony Technology Limited
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Patent number: 10266344
    Abstract: Separating system for separating a support and a product arranged on the support. According to one embodiment the system includes conveying means adapted for receiving the product arranged on its support and for conveying the products in a first conveyance direction. The conveying means includes two product support elements separated from one another in at least one point by a width less than a width of the product (the width of the product being transverse to the first conveyance direction) and greater than the width of its support (with the width of the support being transverse to the first conveyance direction), such that the product is supported by, and conveyed on, the product support elements of the conveying means, and the support is separated from the product upon the product being supported on the product support elements.
    Type: Grant
    Filed: October 3, 2017
    Date of Patent: April 23, 2019
    Assignee: ULMA PACKAGING TECHNOLOGICAL CENTER, S. COOP
    Inventors: Ion Sanchez Mugica, Pedro Jose Caballero Pozo
  • Publication number: 20180130178
    Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprises receiving at least one section of lower-quality visual data; and extracting a subset of features, from the at least one section of lower-quality visual data. A plurality of layers of reduced-dimension visual data from the extracted features are formed and enhanced to form at least one section of higher-quality visual data. The at least one section of higher-quality visual data corresponds to the at least one section of lower-quality visual data received.
    Type: Application
    Filed: August 18, 2017
    Publication date: May 10, 2018
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Publication number: 20180129918
    Abstract: A method for training learned hierarchical algorithms, the method comprising the steps of receiving input data and generating metrics from the input data. At least one hierarchical algorithm is then selected from a plurality of predetermined hierarchical algorithms based on comparing the generated metrics from the input data and like metrics for each of the plurality of predetermined hierarchical algorithms. The selected hierarchical algorithm is developed based on the input data and the developed hierarchical algorithm is outputted.
    Type: Application
    Filed: August 18, 2017
    Publication date: May 10, 2018
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Publication number: 20180130177
    Abstract: A method for enhancing at least a section of lower-quality visual data, the method comprising at least a section of the lower-quality visual data being received. A hierarchical algorithm is then selected from a plurality of hierarchical algorithms, wherein the step of selection is based on a predetermined metric and wherein the hierarchical algorithms were developed using a learned approach and at least one of the hierarchical algorithms is operable to increase the quality of the lower-quality visual data. The selected hierarchical algorithm is then used to increase the quality of the lower-quality visual data to create a higher-quality visual data.
    Type: Application
    Filed: August 17, 2017
    Publication date: May 10, 2018
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
  • Publication number: 20180130179
    Abstract: A method for enhancing lower-quality visual data using hierarchical algorithms, the method comprising the steps of: receiving one or more sections of lower-quality visual data; applying a hierarchical algorithm to the one or more sections of lower-quality visual data to enhance the one or more sections of lower-quality visual data to one or more sections of higher-quality visual data, wherein the hierarchical algorithm was developed using a learned approach; and outputting the one or more sections of higher-quality visual data.
    Type: Application
    Filed: August 18, 2017
    Publication date: May 10, 2018
    Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz