Patents by Inventor Gary Lyons

Gary Lyons has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11975062
    Abstract: The present disclosure relates to Zika virus vaccines and immunogenic compositions having one or more antigens from a Zika virus (e.g., a Zika virus clonal isolate, a non-human cell adapted Zika virus, etc.), and methods of treatments and uses thereof.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: May 7, 2024
    Assignee: Takeda Vaccines, Inc.
    Inventors: Jill A. Livengood, Hansi Dean, Htay Htay Han, Raman Rao, Jackie Marks, Gary Dubin, Laurence De Moerlooze, Hetal Patel, Asae Shintani, Holli Giebler, James Gifford, Mark Lyons, Sushma Kommareddy, Tatsuki Satou
  • Patent number: 11776204
    Abstract: An electronic device receives a set of 2D images comprising at least first 2D image of an object of interest and detects a plurality of 2D landmarks on the first 2D image. The detected plurality of 2D landmarks corresponds to shape-features of the object of interest. The electronic device aligns a first three-dimensional (3D) shape model of a reference object by fitting 2D landmarks of the first 3D shape model to the detected plurality of 2D landmarks. The electronic device estimates texture mapping information between the object of interest and the aligned first 3D shape model and generates a dataset by including the first 2D image, the aligned first 3D shape model, and the estimated texture mapping information as a first sample of the dataset. Based on the generated dataset, the electronic device trains a neural network model on a task of 3D reconstruction from a single 2D image.
    Type: Grant
    Filed: January 21, 2021
    Date of Patent: October 3, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Jong Hwa Lee, Seunghan Kim, Gary Lyons
  • Patent number: 11748943
    Abstract: An electronic device and method of dataset cleaning is provided. The electronic device receives a dataset comprising a plurality of samples, of which a first sample comprises a 2D image of an object of interest and a 3D shape model of the object of interest. The electronic device determines 2D landmarks from the 2D image and extracts 3D landmarks from the 3D shape model. The electronic device computes an error between the determined 2D landmarks and corresponding 2D locations of the extracted 3D landmarks on the 2D image, based on an error metric. Thereafter, the electronic device determines the computed error to be above a threshold. Based on the determination that the computed error is above the threshold, the electronic device updates the dataset by a removal of the first sample from the dataset and trains a neural network on a task of 3D reconstruction, based on the updated dataset.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: September 5, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Jong Hwa Lee, Seunghan Kim, Gary Lyons
  • Patent number: 11410347
    Abstract: A system and method for node-based image colorization is provided. The system receives a first user input via a Graphical User Interface (GUI) of an image/video editing application and controls a display device to display a node graph on the GUI based on the first user input. The node graph includes an input node to select grayscale images and a colorization node which may represent a workflow for colorization of at least a first object in the grayscale images. The system receives a second user input associated with a setting of the colorization node and selects an image colorization model based on the second user input. The system executes the workflow associated with the colorization node to transmit the grayscale images to a computing device that hosts the selected image colorization model, and to receive colorized images including at least the first object colorized based on a color effect.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: August 9, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Jong Hwa Lee, Moises Tafolla, Praggya Garg, Allison Langley, Gary Lyons, Alexander Stoneham, Seunghan Kim, Luis Vasconcelos
  • Patent number: 11405544
    Abstract: An electronic device for programmable rig control for three-dimensional (3D) reconstruction is provided. The electronic device controls a first image sensor to capture a first image of a first scene which includes a set of subjects. The electronic device further feed a first input to a neural network. The electronic device further receives a first output from the neural network based on the fed first input. The electronic device further selects one or more image sensors based on the received first output. The electronic device further controls a first set of structures associated with the selected one or more image sensors to re-arrange a rig around a three-dimensional (3D) physical space. The electronic device further controls a first set of image sensors, in the re-arranged rig, to capture one or more images for generation of one or more three-dimensional (3D) models of a first subject in the 3D physical space.
    Type: Grant
    Filed: February 22, 2021
    Date of Patent: August 2, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Nikolaos Georgis, Gary Lyons, Edward Theodore Winter
  • Publication number: 20220156993
    Abstract: A computing system and method for neural network-based image colorization is provided. The computing system obtains a reference color image by selective application of a color effect on a region of interest of an input image and controls a display device to display a first node graph on a Graphical User Interface of an image/video editing application. The first node graph includes a colorization node representing a first workflow for colorization of at least a first object in grayscale images of a first image feed. The computing system selects the reference color image based on a user input and executes the first workflow associated with the colorization node by feeding the reference color image and the first image feed as an input to a neural network-based colorization model. The computing system receives a second image feed comprising colorized images as output of the neural network-based colorization model for the input.
    Type: Application
    Filed: November 19, 2020
    Publication date: May 19, 2022
    Inventors: JONG HWA LEE, MOISES TAFOLLA, PRAGGYA GARG, ALLISON LANGLEY, GARY LYONS, ALEXANDER STONEHAM, SEUNGHAN KIM, LUIS VASCONCELOS
  • Patent number: 11335048
    Abstract: A computing system and method for neural network-based image colorization is provided. The computing system obtains a reference color image by selective application of a color effect on a region of interest of an input image and controls a display device to display a first node graph on a Graphical User Interface of an image/video editing application. The first node graph includes a colorization node representing a first workflow for colorization of at least a first object in grayscale images of a first image feed. The computing system selects the reference color image based on a user input and executes the first workflow associated with the colorization node by feeding the reference color image and the first image feed as an input to a neural network-based colorization model. The computing system receives a second image feed comprising colorized images as output of the neural network-based colorization model for the input.
    Type: Grant
    Filed: November 19, 2020
    Date of Patent: May 17, 2022
    Assignee: SONY GROUP CORPORATION
    Inventors: Jong Hwa Lee, Moises Tafolla, Praggya Garg, Allison Langley, Gary Lyons, Alexander Stoneham, Seunghan Kim, Luis Vasconcelos
  • Publication number: 20220116531
    Abstract: An electronic device for programmable rig control for three-dimensional (3D) reconstruction is provided. The electronic device controls a first image sensor to capture a first image of a first scene which includes a set of subjects. The electronic device further feed a first input to a neural network. The electronic device further receives a first output from the neural network based on the fed first input. The electronic device further selects one or more image sensors based on the received first output. The electronic device further controls a first set of structures associated with the selected one or more image sensors to re-arrange a rig around a three-dimensional (3D) physical space. The electronic device further controls a first set of image sensors, in the re-arranged rig, to capture one or more images for generation of one or more three-dimensional (3D) models of a first subject in the 3D physical space.
    Type: Application
    Filed: February 22, 2021
    Publication date: April 14, 2022
    Inventors: NIKOLAOS GEORGIS, GARY LYONS, EDWARD THEODORE WINTER
  • Patent number: 11200919
    Abstract: Implementations generally provide a user interface for video annotation tools. In some implementations, a method includes obtaining at least one video of at least one object performing at least one action displaying one or more portions of the at least one video in a user interface. The method further includes displaying a plurality of annotation tracks in the user interface, where each annotation track of the plurality of annotation tracks is associated with one or more of the at least one object and the at least one action in the at least one video. The method further includes obtaining one or more annotations associated with the at least one video based on the plurality of annotation tracks.
    Type: Grant
    Filed: March 10, 2020
    Date of Patent: December 14, 2021
    Assignee: Sony Group Corporation
    Inventors: Gary Lyons, Kenji Suzuki, Brent Faust, Kevin Barnes, Jong Hwa Lee
  • Publication number: 20210319596
    Abstract: A system and method for node-based image colorization is provided. The system receives a first user input via a Graphical User Interface (GUI) of an image/video editing application and controls a display device to display a node graph on the GUI based on the first user input. The node graph includes an input node to select grayscale images and a colorization node which may represent a workflow for colorization of at least a first object in the grayscale images. The system receives a second user input associated with a setting of the colorization node and selects an image colorization model based on the second user input. The system executes the workflow associated with the colorization node to transmit the grayscale images to a computing device that hosts the selected image colorization model, and to receive colorized images including at least the first object colorized based on a color effect.
    Type: Application
    Filed: March 9, 2021
    Publication date: October 14, 2021
    Inventors: JONG HWA LEE, MOISES TAFOLLA, PRAGGYA GARG, ALLISON LANGLEY, GARY LYONS, ALEXANDER STONEHAM, SEUNGHAN KIM, LUIS VASCONCELOS
  • Publication number: 20210303923
    Abstract: An electronic device and method of dataset cleaning is provided. The electronic device receives a dataset comprising a plurality of samples, of which a first sample comprises a 2D image of an object of interest and a 3D shape model of the object of interest. The electronic device determines 2D landmarks from the 2D image and extracts 3D landmarks from the 3D shape model. The electronic device computes an error between the determined 2D landmarks and corresponding 2D locations of the extracted 3D landmarks on the 2D image, based on an error metric. Thereafter, the electronic device determines the computed error to be above a threshold. Based on the determination that the computed error is above the threshold, the electronic device updates the dataset by a removal of the first sample from the dataset and trains a neural network on a task of 3D reconstruction, based on the updated dataset.
    Type: Application
    Filed: February 8, 2021
    Publication date: September 30, 2021
    Inventors: JONG HWA LEE, SEUNGHAN KIM, GARY LYONS
  • Publication number: 20210304516
    Abstract: An electronic device receives a set of 2D images comprising at least first 2D image of an object of interest and detects a plurality of 2D landmarks on the first 2D image. The detected plurality of 2D landmarks corresponds to shape-features of the object of interest. The electronic device aligns a first three-dimensional (3D) shape model of a reference object by fitting 2D landmarks of the first 3D shape model to the detected plurality of 2D landmarks. The electronic device estimates texture mapping information between the object of interest and the aligned first 3D shape model and generates a dataset by including the first 2D image, the aligned first 3D shape model, and the estimated texture mapping information as a first sample of the dataset. Based on the generated dataset, the electronic device trains a neural network model on a task of 3D reconstruction from a single 2D image.
    Type: Application
    Filed: January 21, 2021
    Publication date: September 30, 2021
    Inventors: JONG HWA LEE, SEUNGHAN KIM, GARY LYONS
  • Publication number: 20210287718
    Abstract: Implementations generally provide a user interface for video annotation tools. In some implementations, a method includes obtaining at least one video of at least one object performing at least one action displaying one or more portions of the at least one video in a user interface. The method further includes displaying a plurality of annotation tracks in the user interface, where each annotation track of the plurality of annotation tracks is associated with one or more of the at least one object and the at least one action in the at least one video. The method further includes obtaining one or more annotations associated with the at least one video based on the plurality of annotation tracks.
    Type: Application
    Filed: March 10, 2020
    Publication date: September 16, 2021
    Applicant: Sony Corporation
    Inventors: Gary Lyons, Kenji Suzuki, Brent Faust, Kevin Barnes, Jong Hwa Lee
  • Publication number: 20210287433
    Abstract: Implementations generally provide a 2-dimensional dataset from 2-dimensional and 3-dimensional computer vision techniques. In some implementations, a method includes obtaining a plurality of 2-dimensional (2D) videos of a subject performing at least one action. The method further includes generating a 3-dimensional (3D) model based on the plurality of 2D videos. The method further includes generating a 3D scene based on the 3D model. The method further includes generating a 2D dataset based on the 3D scene.
    Type: Application
    Filed: March 10, 2020
    Publication date: September 16, 2021
    Applicant: Sony Corporation
    Inventors: Gary Lyons, Kenji Suzuki, Brent Faust, Jong Hwa Lee
  • Patent number: 9953446
    Abstract: Various aspects of a method and system to present information via a user interface are disclosed herein. In accordance with an embodiment, the method includes detection of an orientation of an electronic device. The electronic device overlays one or more layers of information on the user interface displayed at the electronic device. Transparency of the overlaid one or more layers of information is dynamically adjusted based on the detected orientation of the electronic device.
    Type: Grant
    Filed: December 24, 2014
    Date of Patent: April 24, 2018
    Assignee: SONY CORPORATION
    Inventors: Gary Lyons, David Young, Jenny Fredriksson, Priyan Gunatilake, Eric Hsiao, Sriram Sampathkumaran
  • Publication number: 20160189405
    Abstract: Various aspects of a method and system to present information via a user interface are disclosed herein. In accordance with an embodiment, the method includes detection of an orientation of an electronic device. The electronic device overlays one or more layers of information on the user interface displayed at the electronic device. Transparency of the overlaid one or more layers of information is dynamically adjusted based on the detected orientation of the electronic device.
    Type: Application
    Filed: December 24, 2014
    Publication date: June 30, 2016
    Inventors: GARY LYONS, DAVID YOUNG, JENNY FREDRIKSSON, PRIYAN GUNATILAKE, ERIC HSIAO, SRIRAM SAMPATHKUMARAN
  • Publication number: 20140143404
    Abstract: Certain aspects of a method and system for communicating with multiple devices may include a network that is capable of communicatively coupling a plurality of peripheral devices to a server. The server may be operable to receive a first set of instructions from a first of the plurality of peripheral devices and transcode the received first set of instructions to a second set of instructions. The transcoded second set of instructions may be communicated to at least one other of the plurality of peripheral devices. The first set of instructions may be based on a first communication protocol and the second set of instructions may be based on a second communication protocol.
    Type: Application
    Filed: November 19, 2012
    Publication date: May 22, 2014
    Applicant: SONY CORPORATION
    Inventors: Sean KENNEDY, Miyuki KUROIWA, Srujana YEDULAPURAM, Craig Robert WESSMAN, Frank SLEEPER, Gary LYONS, Leland TREEBS, Jenny DONG, Eiji TAKAHASHI
  • Patent number: 8726359
    Abstract: A method of managing content related to a plurality of social networking websites. The method comprises accessing a first account that stores user's authentication information of the plurality of the networking websites and connecting to the plurality of social networking websites. Content associated with a second account is obtained from each of the plurality of social networking websites and service capabilities of each of the plurality of social networking websites are tracked. The obtained content from all the social networking websites is displayed on a single page and service information applicable to content is provided.
    Type: Grant
    Filed: October 14, 2011
    Date of Patent: May 13, 2014
    Assignee: Sony Corporation
    Inventors: Sean Kennedy, Gary Lyons, Edward Winter
  • Publication number: 20130282526
    Abstract: A method for displaying product details on a consumer device includes: preparing digital media for display on the device; detecting whether the digital media includes at least one product available for purchase; receiving a plurality of product data sets, each set associated with a product identifier and product details for an available product, the product details including information to initiate a transaction for the product; identifying an index of products in the digital media, the index including for each product a display location and a product identification number; receiving an indication from a user identifying a selected product in the digital media based on a display location in the digital media of the product and/or selection from a listing of the product in the index; retrieving product details for the product based on the product identification number and the product identifier; and displaying the retrieved product details.
    Type: Application
    Filed: February 26, 2013
    Publication date: October 24, 2013
    Applicant: Mastercard International Incorporated
    Inventors: Oran CUMMINS, Gary LYONS, Matthew HOPKINS, Prashant SHARMA, Stephen ELDER, Stephen WHITNEY, Richard BURDETT, Tina DORAN, Michael FRIEDMAN
  • Publication number: 20130253885
    Abstract: Computer-implemented methods for providing performance recommendations during data migration comprising collecting user data and a plurality of running parameters from a user computer, analyzing the plurality of running parameters of the user computer; and suggesting performance recommendations on the basis of the analyzed parameters.
    Type: Application
    Filed: March 20, 2012
    Publication date: September 26, 2013
    Applicant: Sony Corporation
    Inventors: MARC BIRNKRANT, GARY LYONS