Patents by Inventor Gary Lyons
Gary Lyons has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11975062Abstract: The present disclosure relates to Zika virus vaccines and immunogenic compositions having one or more antigens from a Zika virus (e.g., a Zika virus clonal isolate, a non-human cell adapted Zika virus, etc.), and methods of treatments and uses thereof.Type: GrantFiled: November 30, 2018Date of Patent: May 7, 2024Assignee: Takeda Vaccines, Inc.Inventors: Jill A. Livengood, Hansi Dean, Htay Htay Han, Raman Rao, Jackie Marks, Gary Dubin, Laurence De Moerlooze, Hetal Patel, Asae Shintani, Holli Giebler, James Gifford, Mark Lyons, Sushma Kommareddy, Tatsuki Satou
-
Patent number: 11776204Abstract: An electronic device receives a set of 2D images comprising at least first 2D image of an object of interest and detects a plurality of 2D landmarks on the first 2D image. The detected plurality of 2D landmarks corresponds to shape-features of the object of interest. The electronic device aligns a first three-dimensional (3D) shape model of a reference object by fitting 2D landmarks of the first 3D shape model to the detected plurality of 2D landmarks. The electronic device estimates texture mapping information between the object of interest and the aligned first 3D shape model and generates a dataset by including the first 2D image, the aligned first 3D shape model, and the estimated texture mapping information as a first sample of the dataset. Based on the generated dataset, the electronic device trains a neural network model on a task of 3D reconstruction from a single 2D image.Type: GrantFiled: January 21, 2021Date of Patent: October 3, 2023Assignee: SONY GROUP CORPORATIONInventors: Jong Hwa Lee, Seunghan Kim, Gary Lyons
-
Patent number: 11748943Abstract: An electronic device and method of dataset cleaning is provided. The electronic device receives a dataset comprising a plurality of samples, of which a first sample comprises a 2D image of an object of interest and a 3D shape model of the object of interest. The electronic device determines 2D landmarks from the 2D image and extracts 3D landmarks from the 3D shape model. The electronic device computes an error between the determined 2D landmarks and corresponding 2D locations of the extracted 3D landmarks on the 2D image, based on an error metric. Thereafter, the electronic device determines the computed error to be above a threshold. Based on the determination that the computed error is above the threshold, the electronic device updates the dataset by a removal of the first sample from the dataset and trains a neural network on a task of 3D reconstruction, based on the updated dataset.Type: GrantFiled: February 8, 2021Date of Patent: September 5, 2023Assignee: SONY GROUP CORPORATIONInventors: Jong Hwa Lee, Seunghan Kim, Gary Lyons
-
Patent number: 11410347Abstract: A system and method for node-based image colorization is provided. The system receives a first user input via a Graphical User Interface (GUI) of an image/video editing application and controls a display device to display a node graph on the GUI based on the first user input. The node graph includes an input node to select grayscale images and a colorization node which may represent a workflow for colorization of at least a first object in the grayscale images. The system receives a second user input associated with a setting of the colorization node and selects an image colorization model based on the second user input. The system executes the workflow associated with the colorization node to transmit the grayscale images to a computing device that hosts the selected image colorization model, and to receive colorized images including at least the first object colorized based on a color effect.Type: GrantFiled: March 9, 2021Date of Patent: August 9, 2022Assignee: SONY GROUP CORPORATIONInventors: Jong Hwa Lee, Moises Tafolla, Praggya Garg, Allison Langley, Gary Lyons, Alexander Stoneham, Seunghan Kim, Luis Vasconcelos
-
Patent number: 11405544Abstract: An electronic device for programmable rig control for three-dimensional (3D) reconstruction is provided. The electronic device controls a first image sensor to capture a first image of a first scene which includes a set of subjects. The electronic device further feed a first input to a neural network. The electronic device further receives a first output from the neural network based on the fed first input. The electronic device further selects one or more image sensors based on the received first output. The electronic device further controls a first set of structures associated with the selected one or more image sensors to re-arrange a rig around a three-dimensional (3D) physical space. The electronic device further controls a first set of image sensors, in the re-arranged rig, to capture one or more images for generation of one or more three-dimensional (3D) models of a first subject in the 3D physical space.Type: GrantFiled: February 22, 2021Date of Patent: August 2, 2022Assignee: SONY GROUP CORPORATIONInventors: Nikolaos Georgis, Gary Lyons, Edward Theodore Winter
-
Publication number: 20220156993Abstract: A computing system and method for neural network-based image colorization is provided. The computing system obtains a reference color image by selective application of a color effect on a region of interest of an input image and controls a display device to display a first node graph on a Graphical User Interface of an image/video editing application. The first node graph includes a colorization node representing a first workflow for colorization of at least a first object in grayscale images of a first image feed. The computing system selects the reference color image based on a user input and executes the first workflow associated with the colorization node by feeding the reference color image and the first image feed as an input to a neural network-based colorization model. The computing system receives a second image feed comprising colorized images as output of the neural network-based colorization model for the input.Type: ApplicationFiled: November 19, 2020Publication date: May 19, 2022Inventors: JONG HWA LEE, MOISES TAFOLLA, PRAGGYA GARG, ALLISON LANGLEY, GARY LYONS, ALEXANDER STONEHAM, SEUNGHAN KIM, LUIS VASCONCELOS
-
Patent number: 11335048Abstract: A computing system and method for neural network-based image colorization is provided. The computing system obtains a reference color image by selective application of a color effect on a region of interest of an input image and controls a display device to display a first node graph on a Graphical User Interface of an image/video editing application. The first node graph includes a colorization node representing a first workflow for colorization of at least a first object in grayscale images of a first image feed. The computing system selects the reference color image based on a user input and executes the first workflow associated with the colorization node by feeding the reference color image and the first image feed as an input to a neural network-based colorization model. The computing system receives a second image feed comprising colorized images as output of the neural network-based colorization model for the input.Type: GrantFiled: November 19, 2020Date of Patent: May 17, 2022Assignee: SONY GROUP CORPORATIONInventors: Jong Hwa Lee, Moises Tafolla, Praggya Garg, Allison Langley, Gary Lyons, Alexander Stoneham, Seunghan Kim, Luis Vasconcelos
-
Publication number: 20220116531Abstract: An electronic device for programmable rig control for three-dimensional (3D) reconstruction is provided. The electronic device controls a first image sensor to capture a first image of a first scene which includes a set of subjects. The electronic device further feed a first input to a neural network. The electronic device further receives a first output from the neural network based on the fed first input. The electronic device further selects one or more image sensors based on the received first output. The electronic device further controls a first set of structures associated with the selected one or more image sensors to re-arrange a rig around a three-dimensional (3D) physical space. The electronic device further controls a first set of image sensors, in the re-arranged rig, to capture one or more images for generation of one or more three-dimensional (3D) models of a first subject in the 3D physical space.Type: ApplicationFiled: February 22, 2021Publication date: April 14, 2022Inventors: NIKOLAOS GEORGIS, GARY LYONS, EDWARD THEODORE WINTER
-
Patent number: 11200919Abstract: Implementations generally provide a user interface for video annotation tools. In some implementations, a method includes obtaining at least one video of at least one object performing at least one action displaying one or more portions of the at least one video in a user interface. The method further includes displaying a plurality of annotation tracks in the user interface, where each annotation track of the plurality of annotation tracks is associated with one or more of the at least one object and the at least one action in the at least one video. The method further includes obtaining one or more annotations associated with the at least one video based on the plurality of annotation tracks.Type: GrantFiled: March 10, 2020Date of Patent: December 14, 2021Assignee: Sony Group CorporationInventors: Gary Lyons, Kenji Suzuki, Brent Faust, Kevin Barnes, Jong Hwa Lee
-
Publication number: 20210319596Abstract: A system and method for node-based image colorization is provided. The system receives a first user input via a Graphical User Interface (GUI) of an image/video editing application and controls a display device to display a node graph on the GUI based on the first user input. The node graph includes an input node to select grayscale images and a colorization node which may represent a workflow for colorization of at least a first object in the grayscale images. The system receives a second user input associated with a setting of the colorization node and selects an image colorization model based on the second user input. The system executes the workflow associated with the colorization node to transmit the grayscale images to a computing device that hosts the selected image colorization model, and to receive colorized images including at least the first object colorized based on a color effect.Type: ApplicationFiled: March 9, 2021Publication date: October 14, 2021Inventors: JONG HWA LEE, MOISES TAFOLLA, PRAGGYA GARG, ALLISON LANGLEY, GARY LYONS, ALEXANDER STONEHAM, SEUNGHAN KIM, LUIS VASCONCELOS
-
Publication number: 20210303923Abstract: An electronic device and method of dataset cleaning is provided. The electronic device receives a dataset comprising a plurality of samples, of which a first sample comprises a 2D image of an object of interest and a 3D shape model of the object of interest. The electronic device determines 2D landmarks from the 2D image and extracts 3D landmarks from the 3D shape model. The electronic device computes an error between the determined 2D landmarks and corresponding 2D locations of the extracted 3D landmarks on the 2D image, based on an error metric. Thereafter, the electronic device determines the computed error to be above a threshold. Based on the determination that the computed error is above the threshold, the electronic device updates the dataset by a removal of the first sample from the dataset and trains a neural network on a task of 3D reconstruction, based on the updated dataset.Type: ApplicationFiled: February 8, 2021Publication date: September 30, 2021Inventors: JONG HWA LEE, SEUNGHAN KIM, GARY LYONS
-
Publication number: 20210304516Abstract: An electronic device receives a set of 2D images comprising at least first 2D image of an object of interest and detects a plurality of 2D landmarks on the first 2D image. The detected plurality of 2D landmarks corresponds to shape-features of the object of interest. The electronic device aligns a first three-dimensional (3D) shape model of a reference object by fitting 2D landmarks of the first 3D shape model to the detected plurality of 2D landmarks. The electronic device estimates texture mapping information between the object of interest and the aligned first 3D shape model and generates a dataset by including the first 2D image, the aligned first 3D shape model, and the estimated texture mapping information as a first sample of the dataset. Based on the generated dataset, the electronic device trains a neural network model on a task of 3D reconstruction from a single 2D image.Type: ApplicationFiled: January 21, 2021Publication date: September 30, 2021Inventors: JONG HWA LEE, SEUNGHAN KIM, GARY LYONS
-
Publication number: 20210287718Abstract: Implementations generally provide a user interface for video annotation tools. In some implementations, a method includes obtaining at least one video of at least one object performing at least one action displaying one or more portions of the at least one video in a user interface. The method further includes displaying a plurality of annotation tracks in the user interface, where each annotation track of the plurality of annotation tracks is associated with one or more of the at least one object and the at least one action in the at least one video. The method further includes obtaining one or more annotations associated with the at least one video based on the plurality of annotation tracks.Type: ApplicationFiled: March 10, 2020Publication date: September 16, 2021Applicant: Sony CorporationInventors: Gary Lyons, Kenji Suzuki, Brent Faust, Kevin Barnes, Jong Hwa Lee
-
Publication number: 20210287433Abstract: Implementations generally provide a 2-dimensional dataset from 2-dimensional and 3-dimensional computer vision techniques. In some implementations, a method includes obtaining a plurality of 2-dimensional (2D) videos of a subject performing at least one action. The method further includes generating a 3-dimensional (3D) model based on the plurality of 2D videos. The method further includes generating a 3D scene based on the 3D model. The method further includes generating a 2D dataset based on the 3D scene.Type: ApplicationFiled: March 10, 2020Publication date: September 16, 2021Applicant: Sony CorporationInventors: Gary Lyons, Kenji Suzuki, Brent Faust, Jong Hwa Lee
-
Patent number: 9953446Abstract: Various aspects of a method and system to present information via a user interface are disclosed herein. In accordance with an embodiment, the method includes detection of an orientation of an electronic device. The electronic device overlays one or more layers of information on the user interface displayed at the electronic device. Transparency of the overlaid one or more layers of information is dynamically adjusted based on the detected orientation of the electronic device.Type: GrantFiled: December 24, 2014Date of Patent: April 24, 2018Assignee: SONY CORPORATIONInventors: Gary Lyons, David Young, Jenny Fredriksson, Priyan Gunatilake, Eric Hsiao, Sriram Sampathkumaran
-
Publication number: 20160189405Abstract: Various aspects of a method and system to present information via a user interface are disclosed herein. In accordance with an embodiment, the method includes detection of an orientation of an electronic device. The electronic device overlays one or more layers of information on the user interface displayed at the electronic device. Transparency of the overlaid one or more layers of information is dynamically adjusted based on the detected orientation of the electronic device.Type: ApplicationFiled: December 24, 2014Publication date: June 30, 2016Inventors: GARY LYONS, DAVID YOUNG, JENNY FREDRIKSSON, PRIYAN GUNATILAKE, ERIC HSIAO, SRIRAM SAMPATHKUMARAN
-
Publication number: 20140143404Abstract: Certain aspects of a method and system for communicating with multiple devices may include a network that is capable of communicatively coupling a plurality of peripheral devices to a server. The server may be operable to receive a first set of instructions from a first of the plurality of peripheral devices and transcode the received first set of instructions to a second set of instructions. The transcoded second set of instructions may be communicated to at least one other of the plurality of peripheral devices. The first set of instructions may be based on a first communication protocol and the second set of instructions may be based on a second communication protocol.Type: ApplicationFiled: November 19, 2012Publication date: May 22, 2014Applicant: SONY CORPORATIONInventors: Sean KENNEDY, Miyuki KUROIWA, Srujana YEDULAPURAM, Craig Robert WESSMAN, Frank SLEEPER, Gary LYONS, Leland TREEBS, Jenny DONG, Eiji TAKAHASHI
-
Patent number: 8726359Abstract: A method of managing content related to a plurality of social networking websites. The method comprises accessing a first account that stores user's authentication information of the plurality of the networking websites and connecting to the plurality of social networking websites. Content associated with a second account is obtained from each of the plurality of social networking websites and service capabilities of each of the plurality of social networking websites are tracked. The obtained content from all the social networking websites is displayed on a single page and service information applicable to content is provided.Type: GrantFiled: October 14, 2011Date of Patent: May 13, 2014Assignee: Sony CorporationInventors: Sean Kennedy, Gary Lyons, Edward Winter
-
Publication number: 20130282526Abstract: A method for displaying product details on a consumer device includes: preparing digital media for display on the device; detecting whether the digital media includes at least one product available for purchase; receiving a plurality of product data sets, each set associated with a product identifier and product details for an available product, the product details including information to initiate a transaction for the product; identifying an index of products in the digital media, the index including for each product a display location and a product identification number; receiving an indication from a user identifying a selected product in the digital media based on a display location in the digital media of the product and/or selection from a listing of the product in the index; retrieving product details for the product based on the product identification number and the product identifier; and displaying the retrieved product details.Type: ApplicationFiled: February 26, 2013Publication date: October 24, 2013Applicant: Mastercard International IncorporatedInventors: Oran CUMMINS, Gary LYONS, Matthew HOPKINS, Prashant SHARMA, Stephen ELDER, Stephen WHITNEY, Richard BURDETT, Tina DORAN, Michael FRIEDMAN
-
Publication number: 20130253885Abstract: Computer-implemented methods for providing performance recommendations during data migration comprising collecting user data and a plurality of running parameters from a user computer, analyzing the plurality of running parameters of the user computer; and suggesting performance recommendations on the basis of the analyzed parameters.Type: ApplicationFiled: March 20, 2012Publication date: September 26, 2013Applicant: Sony CorporationInventors: MARC BIRNKRANT, GARY LYONS