Patents by Inventor Johannes Totz
Johannes Totz has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11528492Abstract: A method for developing an enhancement model for low-quality visual data, the method comprising the steps of receiving one or more sections of higher-quality visual data; and training a hierarchical algorithm. The hierarchical algorithm is operable to increase the quality of one or more sections of lower-quality visual data so as to substantially reproduce the one or more sections of higher-quality visual data. The hierarchical algorithm is then outputted.Type: GrantFiled: August 17, 2017Date of Patent: December 13, 2022Assignee: Twitter, Inc.Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Patent number: 11122238Abstract: A method includes selecting two or more frames from a plurality of frames of a video, downscaling the two or more frames, estimating a flow data based on an optical flow associated with the downscaled two or more frames, upscaling the flow data, generating a refined flow data based on the upscaled flow data and the downscaled two or more frames, upscaling the refined flow data, and synthesizing an image based on the upscaled refined flow data and the two or more frames.Type: GrantFiled: November 7, 2018Date of Patent: September 14, 2021Assignee: Twitter, Inc.Inventors: Joost van Amersfoort, Wenzhe Shi, Jose Caballero, Alfredo Alejandro Acosta Diaz, Francisco Massa, Johannes Totz, Zehan Wang
-
Patent number: 10904541Abstract: A method for increasing the quality of a section of visual data communicated over a network from a first node to a second node, the method at the second node including receiving a lower-quality visual data via a network, receiving a corresponding reference to an algorithm operable to increase a quality of the lower-quality visual data, the algorithm selected based on a higher-quality visual data from which the lower-quality visual data was generated, and using the algorithm to increase the quality of the lower-quality visual data to recreate the higher-quality visual data.Type: GrantFiled: August 18, 2017Date of Patent: January 26, 2021Assignee: Magic Pony Technology LimitedInventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Patent number: 10887613Abstract: A method for enhancing one or more sections of lower-quality visual data using a hierarchical algorithm, the method comprising receiving one or more sections of lower-quality visual data. The one or more sections of lower-quality visual data are enhanced to one or more sections of higher-quality visual data using the hierarchical algorithm. Additionally, at least the first step of the hierarchical algorithm is performed in a lower-quality domain; and wherein the hierarchical algorithm operates in both a higher-quality domain and the lower-quality domain.Type: GrantFiled: August 17, 2017Date of Patent: January 5, 2021Assignee: Magic Pony Technology LimitedInventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Patent number: 10701394Abstract: A method includes selecting a plurality of low-resolution frames associated with a video, performing a first motion estimation between a first frame and a second frame, performing a second motion estimation between a third frame and the second frame, generating a high-resolution frame representing the second frame based on the first motion estimation, the second motion estimation and the second frame using a sub-pixel convolutional neural network.Type: GrantFiled: November 10, 2017Date of Patent: June 30, 2020Assignee: Twitter, Inc.Inventors: Jose Caballero, Christian Ledig, Andrew Aitken, Alfredo Alejandro Acosta Diaz, Lucas Theis, Ferenc Huszar, Johannes Totz, Zehan Wang, Wenzhe Shi
-
Patent number: 10630996Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method including receiving at least a plurality of neighbouring sections of lower-quality visual data. A plurality of input sections from the received plurality of neighbouring sections of lower quality visual data are selected and features are extracted from those plurality of input sections of lower-quality visual data. A target section based on the extracted features from the plurality of input sections of lower-quality visual data is then enhanced.Type: GrantFiled: August 18, 2017Date of Patent: April 21, 2020Assignee: Magic Pony Technology LimitedInventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Patent number: 10623756Abstract: A method for enhancing lower-quality visual data using hierarchical algorithms, the method comprising the steps of: receiving one or more sections of lower-quality visual data; applying a hierarchical algorithm to the one or more sections of lower-quality visual data to enhance the one or more sections of lower-quality visual data to one or more sections of higher-quality visual data, wherein the hierarchical algorithm was developed using a learned approach; and outputting the one or more sections of higher-quality visual data.Type: GrantFiled: August 18, 2017Date of Patent: April 14, 2020Assignee: Magic Pony Technology LimitedInventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Patent number: 10582205Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprises receiving at least one section of lower-quality visual data; and extracting a subset of features, from the at least one section of lower-quality visual data. A plurality of layers of reduced-dimension visual data from the extracted features are formed and enhanced to form at least one section of higher-quality visual data. The at least one section of higher-quality visual data corresponds to the at least one section of lower-quality visual data received.Type: GrantFiled: August 18, 2017Date of Patent: March 3, 2020Assignee: Magic Pony Technology LimitedInventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Patent number: 10547858Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprising receiving at least a plurality of neighbouring sections of lower-quality visual data. A plurality of input sections from the received plurality of neighbouring sections of lower quality visual data are selected and features are extracted from those plurality of input sections of lower-quality visual data. A target section based on the extracted features from the plurality of input sections of lower-quality visual data is then enhanced.Type: GrantFiled: August 17, 2017Date of Patent: January 28, 2020Assignee: Magic Pony Technology LimitedInventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Patent number: 10523955Abstract: A method for enhancing at least a section of lower-quality visual data, the method comprising at least a section of the lower-quality visual data being received. A hierarchical algorithm is then selected from a plurality of hierarchical algorithms, wherein the step of selection is based on a predetermined metric and wherein the hierarchical algorithms were developed using a learned approach and at least one of the hierarchical algorithms is operable to increase the quality of the lower-quality visual data. The selected hierarchical algorithm is then used to increase the quality of the lower-quality visual data to create a higher-quality visual data.Type: GrantFiled: August 17, 2017Date of Patent: December 31, 2019Assignee: Magic Pony Technology LimitedInventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Patent number: 10516890Abstract: A method for training learned hierarchical algorithms, the method comprising the steps of receiving input data and generating metrics from the input data. At least one hierarchical algorithm is then selected from a plurality of predetermined hierarchical algorithms based on comparing the generated metrics from the input data and like metrics for each of the plurality of predetermined hierarchical algorithms. The selected hierarchical algorithm is developed based on the input data and the developed hierarchical algorithm is outputted.Type: GrantFiled: August 18, 2017Date of Patent: December 24, 2019Assignee: Magic Pony Technology LimitedInventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Patent number: 10499069Abstract: A method for enhancing visual data when communicating visual data over a network from a first node to a second node. The method at the first node comprises developing at least one modified hierarchical algorithm from a known hierarchical algorithm operable to substantially recreate at least one section of higher-quality visual data. References to one or more known hierarchical algorithms from which the modified hierarchical algorithms were developed are transmitted to the second node along with one or more modifications to the one or more known hierarchical algorithms operable to reproduce the one or more modified hierarchical algorithms from the known hierarchical algorithms. The second node is able to recreate substantially the higher-quality video using the modified hierarchical algorithm.Type: GrantFiled: August 18, 2017Date of Patent: December 3, 2019Assignee: Magic Pony Technology LimitedInventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Publication number: 20180130180Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method including receiving at least a plurality of neighbouring sections of lower-quality visual data. A plurality of input sections from the received plurality of neighbouring sections of lower quality visual data are selected and features are extracted from those plurality of input sections of lower-quality visual data. A target section based on the extracted features from the plurality of input sections of lower-quality visual data is then enhanced.Type: ApplicationFiled: August 18, 2017Publication date: May 10, 2018Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Publication number: 20180130178Abstract: A method for enhancing at least a section of lower-quality visual data using a hierarchical algorithm, the method comprises receiving at least one section of lower-quality visual data; and extracting a subset of features, from the at least one section of lower-quality visual data. A plurality of layers of reduced-dimension visual data from the extracted features are formed and enhanced to form at least one section of higher-quality visual data. The at least one section of higher-quality visual data corresponds to the at least one section of lower-quality visual data received.Type: ApplicationFiled: August 18, 2017Publication date: May 10, 2018Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Publication number: 20180130177Abstract: A method for enhancing at least a section of lower-quality visual data, the method comprising at least a section of the lower-quality visual data being received. A hierarchical algorithm is then selected from a plurality of hierarchical algorithms, wherein the step of selection is based on a predetermined metric and wherein the hierarchical algorithms were developed using a learned approach and at least one of the hierarchical algorithms is operable to increase the quality of the lower-quality visual data. The selected hierarchical algorithm is then used to increase the quality of the lower-quality visual data to create a higher-quality visual data.Type: ApplicationFiled: August 17, 2017Publication date: May 10, 2018Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Publication number: 20180130179Abstract: A method for enhancing lower-quality visual data using hierarchical algorithms, the method comprising the steps of: receiving one or more sections of lower-quality visual data; applying a hierarchical algorithm to the one or more sections of lower-quality visual data to enhance the one or more sections of lower-quality visual data to one or more sections of higher-quality visual data, wherein the hierarchical algorithm was developed using a learned approach; and outputting the one or more sections of higher-quality visual data.Type: ApplicationFiled: August 18, 2017Publication date: May 10, 2018Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Publication number: 20180129918Abstract: A method for training learned hierarchical algorithms, the method comprising the steps of receiving input data and generating metrics from the input data. At least one hierarchical algorithm is then selected from a plurality of predetermined hierarchical algorithms based on comparing the generated metrics from the input data and like metrics for each of the plurality of predetermined hierarchical algorithms. The selected hierarchical algorithm is developed based on the input data and the developed hierarchical algorithm is outputted.Type: ApplicationFiled: August 18, 2017Publication date: May 10, 2018Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Publication number: 20170374374Abstract: A method for increasing the quality of a section of visual data communicated over a network from a first node to a second node, the method at the second node including receiving a lower-quality visual data via a network, receiving a corresponding reference to an algorithm operable to increase a quality of the lower-quality visual data, the algorithm selected based on a higher-quality visual data from which the lower-quality visual data was generated, and using the algorithm to increase the quality of the lower-quality visual data to recreate the higher-quality visual data.Type: ApplicationFiled: August 18, 2017Publication date: December 28, 2017Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Publication number: 20170345130Abstract: A method for enhancing visual data when communicating visual data over a network from a first node to a second node. The method at the first node comprises developing at least one modified hierarchical algorithm from a known hierarchical algorithm operable to substantially recreate at least one section of higher-quality visual data. References to one or more known hierarchical algorithms from which the modified hierarchical algorithms were developed are transmitted to the second node along with one or more modifications to the one or more known hierarchical algorithms operable to reproduce the one or more modified hierarchical algorithms from the known hierarchical algorithms. The second node is able to recreate substantially the higher-quality video using the modified hierarchical algorithm.Type: ApplicationFiled: August 18, 2017Publication date: November 30, 2017Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz
-
Publication number: 20170347060Abstract: A method for enhancing one or more sections of lower-quality visual data using a hierarchical algorithm, the method comprising receiving one or more sections of lower-quality visual data. The one or more sections of lower-quality visual data are enhanced to one or more sections of higher-quality visual data using the hierarchical algorithm. Additionally, at least the first step of the hierarchical algorithm is performed in a lower-quality domain; and wherein the hierarchical algorithm operates in both a higher-quality domain and the lower-quality domain.Type: ApplicationFiled: August 17, 2017Publication date: November 30, 2017Inventors: Zehan Wang, Robert David Bishop, Wenzhe Shi, Jose Caballero, Andrew Peter Aitken, Johannes Totz