Patents by Inventor Brent Faust

Brent Faust has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11743444
    Abstract: Provided is an electronic device for a temporal synchronization, which determines a set of parameters associated with each imaging device of a plurality of imaging devices. The set of parameters include frame rate of each imaging device. The electronic device generates a synchronization signal that includes a preamble pulse of a first time duration set based on the frame rate and a sequence of alternating ON and OFF pulses. Each pulse of the sequence of alternating ON and OFF pulses is of a second time duration set based on the set of parameters. Based on the synchronization signal, lighting devices may be controlled to generate a pattern of alternating light pulses that is captured by each imaging device. The electronic device further acquires a plurality of images that includes information about the pattern of alternating light pulses. The electronic device further synchronizes the plurality of images, based on the information.
    Type: Grant
    Filed: September 2, 2021
    Date of Patent: August 29, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Brent Faust, Cheng-Yi Liu
  • Patent number: 11659132
    Abstract: An electronic device including circuitry is provided. The circuitry generates a synchronization signal. The circuitry controls drive of one or more light-emitting devices based on the synchronization signal to generate a pattern of alternating light pulses. The circuitry further acquires a plurality of videos of the pattern of alternating light pulses from a plurality of imaging devices. The one or more light-emitting devices are positioned in a field of view of each of the plurality of imaging devices. The circuitry determines a frame in each video of the plurality of videos that includes a specific portion of the pattern of alternating light pulses. The determined frame in each of the plurality of videos corresponds to the same time instant. The circuitry synchronizes the plurality of videos based on the determination.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: May 23, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Brent Faust, Edward Theodore Winter, Jianfei Max Chen
  • Publication number: 20230135230
    Abstract: An electronic device is provided that determines initial three-dimensional (3D) coordinates of a lighting device. The electronic device controls an emission of light from the lighting device based on control signals. The emitted light includes at least one of a pattern of alternating light pulses or a continuous light pulse. The electronic device controls a plurality of imaging devices to capture a first plurality of images that include information about the emitted light. Based on the determined initial 3D coordinates and the information about the emitted light included in the first plurality of images, the electronic device estimates a plurality of rotation values and a plurality of translation values of each imaging device. Based on the plurality of rotation values and the plurality of translation values, the electronic device applies a simultaneous localization and mapping process for each imaging device, for spatial synchronization of the plurality of imaging devices.
    Type: Application
    Filed: November 1, 2021
    Publication date: May 4, 2023
    Inventors: BRENT FAUST, CHENG-YI LIU
  • Publication number: 20230087345
    Abstract: An electronic device including circuitry is provided. The circuitry generates a synchronization signal. The circuitry controls drive of one or more light-emitting devices based on the synchronization signal to generate a pattern of alternating light pulses. The circuitry further acquires a plurality of videos of the pattern of alternating light pulses from a plurality of imaging devices. The one or more light-emitting devices are positioned in a field of view of each of the plurality of imaging devices. The circuitry determines a frame in each video of the plurality of videos that includes a specific portion of the pattern of alternating light pulses. The determined frame in each of the plurality of videos corresponds to the same time instant. The circuitry synchronizes the plurality of videos based on the determination.
    Type: Application
    Filed: September 22, 2021
    Publication date: March 23, 2023
    Inventors: BRENT FAUST, EDWARD THEODORE WINTER, JIANFEI MAX CHEN
  • Publication number: 20230072555
    Abstract: Provided is an electronic device for a temporal synchronization, which determines a set of parameters associated with each imaging device of a plurality of imaging devices. The set of parameters include frame rate of each imaging device. The electronic device generates a synchronization signal that includes a preamble pulse of a first time duration set based on the frame rate and a sequence of alternating ON and OFF pulses. Each pulse of the sequence of alternating ON and OFF pulses is of a second time duration set based on the set of parameters. Based on the synchronization signal, lighting devices may be controlled to generate a pattern of alternating light pulses that is captured by each imaging device. The electronic device further acquires a plurality of images that includes information about the pattern of alternating light pulses. The electronic device further synchronizes the plurality of images, based on the information.
    Type: Application
    Filed: September 2, 2021
    Publication date: March 9, 2023
    Inventors: BRENT FAUST, CHENG-YI LIU
  • Publication number: 20230058405
    Abstract: A method and a system for unmanned aerial vehicle (UAV) swarm control is provided. The system includes a plurality of UAVs including a leader UAV and a plurality of follower UAVs communicably coupled with the leader UAV. The system further includes a Ground Control Station (GCS). The GCS determines a geo-location of the leader UAV and determines formation information based on the geo-location. The formation information indicates a relative position for each follower UAV with respect to the leader UAV. The GCS further transmits the formation information directly to each of the leader UAV and the plurality of follower UAVs. Each follower UAV receives the formation information and adjusts a position based on the formation information.
    Type: Application
    Filed: August 20, 2021
    Publication date: February 23, 2023
    Inventors: JIANFAI MAX CHEN, EDWARD THEODORE WINTER, BRENT FAUST
  • Patent number: 11461905
    Abstract: Implementations generally relate to determining a kinematic sequence. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes converting two-dimensional (2D) coordinates of the plurality of points to three-dimensional (3D) coordinates, where the converting is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: October 4, 2022
    Assignee: Sony Group Corporation
    Inventors: Jong Hwa Lee, Brent Faust, Kenji Suzuki, Arun Chandrasekar, Joseph Moon, Xihe Zhang
  • Patent number: 11222428
    Abstract: Implementations generally relate to determining golf swing characteristics. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes determining a plurality of three-dimensional (3D) coordinates for each point of the plurality of points, where the determining of the 3D coordinates is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates. The method further includes determining one or more movement errors based at least in part on the movement of the plurality of points.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: January 11, 2022
    Assignee: Sony Group Corporation
    Inventors: Jong Hwa Lee, Brent Faust, Kenji Suzuki, Arun Chandrasekar, Joseph Moon, Xihe Zhang
  • Patent number: 11200919
    Abstract: Implementations generally provide a user interface for video annotation tools. In some implementations, a method includes obtaining at least one video of at least one object performing at least one action displaying one or more portions of the at least one video in a user interface. The method further includes displaying a plurality of annotation tracks in the user interface, where each annotation track of the plurality of annotation tracks is associated with one or more of the at least one object and the at least one action in the at least one video. The method further includes obtaining one or more annotations associated with the at least one video based on the plurality of annotation tracks.
    Type: Grant
    Filed: March 10, 2020
    Date of Patent: December 14, 2021
    Assignee: Sony Group Corporation
    Inventors: Gary Lyons, Kenji Suzuki, Brent Faust, Kevin Barnes, Jong Hwa Lee
  • Publication number: 20210287433
    Abstract: Implementations generally provide a 2-dimensional dataset from 2-dimensional and 3-dimensional computer vision techniques. In some implementations, a method includes obtaining a plurality of 2-dimensional (2D) videos of a subject performing at least one action. The method further includes generating a 3-dimensional (3D) model based on the plurality of 2D videos. The method further includes generating a 3D scene based on the 3D model. The method further includes generating a 2D dataset based on the 3D scene.
    Type: Application
    Filed: March 10, 2020
    Publication date: September 16, 2021
    Applicant: Sony Corporation
    Inventors: Gary Lyons, Kenji Suzuki, Brent Faust, Jong Hwa Lee
  • Publication number: 20210287718
    Abstract: Implementations generally provide a user interface for video annotation tools. In some implementations, a method includes obtaining at least one video of at least one object performing at least one action displaying one or more portions of the at least one video in a user interface. The method further includes displaying a plurality of annotation tracks in the user interface, where each annotation track of the plurality of annotation tracks is associated with one or more of the at least one object and the at least one action in the at least one video. The method further includes obtaining one or more annotations associated with the at least one video based on the plurality of annotation tracks.
    Type: Application
    Filed: March 10, 2020
    Publication date: September 16, 2021
    Applicant: Sony Corporation
    Inventors: Gary Lyons, Kenji Suzuki, Brent Faust, Kevin Barnes, Jong Hwa Lee
  • Publication number: 20200320719
    Abstract: Implementations generally relate to determining a kinematic sequence. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes converting two-dimensional (2D) coordinates of the plurality of points to three-dimensional (3D) coordinates, where the converting is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates.
    Type: Application
    Filed: September 20, 2019
    Publication date: October 8, 2020
    Applicant: Sony Corporation
    Inventors: Jong Hwa Lee, Brent Faust, Kenji Suzuki, Arun Chandrasekar, Joseph Moon, Xihe Zhang
  • Publication number: 20200320283
    Abstract: Implementations generally relate to determining golf swing characteristics. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes determining a plurality of three-dimensional (3D) coordinates for each point of the plurality of points, where the determining of the 3D coordinates is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates. The method further includes determining one or more movement errors based at least in part on the movement of the plurality of points.
    Type: Application
    Filed: September 20, 2019
    Publication date: October 8, 2020
    Applicant: Sony Corporation
    Inventors: Jong Hwa Lee, Brent Faust, Kenji Suzuki, Arun Chandrasekar, Joseph Moon, Xihe Zhang