Patents by Inventor Brent Faust
Brent Faust has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11743444Abstract: Provided is an electronic device for a temporal synchronization, which determines a set of parameters associated with each imaging device of a plurality of imaging devices. The set of parameters include frame rate of each imaging device. The electronic device generates a synchronization signal that includes a preamble pulse of a first time duration set based on the frame rate and a sequence of alternating ON and OFF pulses. Each pulse of the sequence of alternating ON and OFF pulses is of a second time duration set based on the set of parameters. Based on the synchronization signal, lighting devices may be controlled to generate a pattern of alternating light pulses that is captured by each imaging device. The electronic device further acquires a plurality of images that includes information about the pattern of alternating light pulses. The electronic device further synchronizes the plurality of images, based on the information.Type: GrantFiled: September 2, 2021Date of Patent: August 29, 2023Assignee: SONY GROUP CORPORATIONInventors: Brent Faust, Cheng-Yi Liu
-
Patent number: 11659132Abstract: An electronic device including circuitry is provided. The circuitry generates a synchronization signal. The circuitry controls drive of one or more light-emitting devices based on the synchronization signal to generate a pattern of alternating light pulses. The circuitry further acquires a plurality of videos of the pattern of alternating light pulses from a plurality of imaging devices. The one or more light-emitting devices are positioned in a field of view of each of the plurality of imaging devices. The circuitry determines a frame in each video of the plurality of videos that includes a specific portion of the pattern of alternating light pulses. The determined frame in each of the plurality of videos corresponds to the same time instant. The circuitry synchronizes the plurality of videos based on the determination.Type: GrantFiled: September 22, 2021Date of Patent: May 23, 2023Assignee: SONY GROUP CORPORATIONInventors: Brent Faust, Edward Theodore Winter, Jianfei Max Chen
-
Publication number: 20230135230Abstract: An electronic device is provided that determines initial three-dimensional (3D) coordinates of a lighting device. The electronic device controls an emission of light from the lighting device based on control signals. The emitted light includes at least one of a pattern of alternating light pulses or a continuous light pulse. The electronic device controls a plurality of imaging devices to capture a first plurality of images that include information about the emitted light. Based on the determined initial 3D coordinates and the information about the emitted light included in the first plurality of images, the electronic device estimates a plurality of rotation values and a plurality of translation values of each imaging device. Based on the plurality of rotation values and the plurality of translation values, the electronic device applies a simultaneous localization and mapping process for each imaging device, for spatial synchronization of the plurality of imaging devices.Type: ApplicationFiled: November 1, 2021Publication date: May 4, 2023Inventors: BRENT FAUST, CHENG-YI LIU
-
Publication number: 20230087345Abstract: An electronic device including circuitry is provided. The circuitry generates a synchronization signal. The circuitry controls drive of one or more light-emitting devices based on the synchronization signal to generate a pattern of alternating light pulses. The circuitry further acquires a plurality of videos of the pattern of alternating light pulses from a plurality of imaging devices. The one or more light-emitting devices are positioned in a field of view of each of the plurality of imaging devices. The circuitry determines a frame in each video of the plurality of videos that includes a specific portion of the pattern of alternating light pulses. The determined frame in each of the plurality of videos corresponds to the same time instant. The circuitry synchronizes the plurality of videos based on the determination.Type: ApplicationFiled: September 22, 2021Publication date: March 23, 2023Inventors: BRENT FAUST, EDWARD THEODORE WINTER, JIANFEI MAX CHEN
-
Publication number: 20230072555Abstract: Provided is an electronic device for a temporal synchronization, which determines a set of parameters associated with each imaging device of a plurality of imaging devices. The set of parameters include frame rate of each imaging device. The electronic device generates a synchronization signal that includes a preamble pulse of a first time duration set based on the frame rate and a sequence of alternating ON and OFF pulses. Each pulse of the sequence of alternating ON and OFF pulses is of a second time duration set based on the set of parameters. Based on the synchronization signal, lighting devices may be controlled to generate a pattern of alternating light pulses that is captured by each imaging device. The electronic device further acquires a plurality of images that includes information about the pattern of alternating light pulses. The electronic device further synchronizes the plurality of images, based on the information.Type: ApplicationFiled: September 2, 2021Publication date: March 9, 2023Inventors: BRENT FAUST, CHENG-YI LIU
-
Publication number: 20230058405Abstract: A method and a system for unmanned aerial vehicle (UAV) swarm control is provided. The system includes a plurality of UAVs including a leader UAV and a plurality of follower UAVs communicably coupled with the leader UAV. The system further includes a Ground Control Station (GCS). The GCS determines a geo-location of the leader UAV and determines formation information based on the geo-location. The formation information indicates a relative position for each follower UAV with respect to the leader UAV. The GCS further transmits the formation information directly to each of the leader UAV and the plurality of follower UAVs. Each follower UAV receives the formation information and adjusts a position based on the formation information.Type: ApplicationFiled: August 20, 2021Publication date: February 23, 2023Inventors: JIANFAI MAX CHEN, EDWARD THEODORE WINTER, BRENT FAUST
-
Patent number: 11461905Abstract: Implementations generally relate to determining a kinematic sequence. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes converting two-dimensional (2D) coordinates of the plurality of points to three-dimensional (3D) coordinates, where the converting is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates.Type: GrantFiled: September 20, 2019Date of Patent: October 4, 2022Assignee: Sony Group CorporationInventors: Jong Hwa Lee, Brent Faust, Kenji Suzuki, Arun Chandrasekar, Joseph Moon, Xihe Zhang
-
Patent number: 11222428Abstract: Implementations generally relate to determining golf swing characteristics. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes determining a plurality of three-dimensional (3D) coordinates for each point of the plurality of points, where the determining of the 3D coordinates is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates. The method further includes determining one or more movement errors based at least in part on the movement of the plurality of points.Type: GrantFiled: September 20, 2019Date of Patent: January 11, 2022Assignee: Sony Group CorporationInventors: Jong Hwa Lee, Brent Faust, Kenji Suzuki, Arun Chandrasekar, Joseph Moon, Xihe Zhang
-
Patent number: 11200919Abstract: Implementations generally provide a user interface for video annotation tools. In some implementations, a method includes obtaining at least one video of at least one object performing at least one action displaying one or more portions of the at least one video in a user interface. The method further includes displaying a plurality of annotation tracks in the user interface, where each annotation track of the plurality of annotation tracks is associated with one or more of the at least one object and the at least one action in the at least one video. The method further includes obtaining one or more annotations associated with the at least one video based on the plurality of annotation tracks.Type: GrantFiled: March 10, 2020Date of Patent: December 14, 2021Assignee: Sony Group CorporationInventors: Gary Lyons, Kenji Suzuki, Brent Faust, Kevin Barnes, Jong Hwa Lee
-
Publication number: 20210287433Abstract: Implementations generally provide a 2-dimensional dataset from 2-dimensional and 3-dimensional computer vision techniques. In some implementations, a method includes obtaining a plurality of 2-dimensional (2D) videos of a subject performing at least one action. The method further includes generating a 3-dimensional (3D) model based on the plurality of 2D videos. The method further includes generating a 3D scene based on the 3D model. The method further includes generating a 2D dataset based on the 3D scene.Type: ApplicationFiled: March 10, 2020Publication date: September 16, 2021Applicant: Sony CorporationInventors: Gary Lyons, Kenji Suzuki, Brent Faust, Jong Hwa Lee
-
Publication number: 20210287718Abstract: Implementations generally provide a user interface for video annotation tools. In some implementations, a method includes obtaining at least one video of at least one object performing at least one action displaying one or more portions of the at least one video in a user interface. The method further includes displaying a plurality of annotation tracks in the user interface, where each annotation track of the plurality of annotation tracks is associated with one or more of the at least one object and the at least one action in the at least one video. The method further includes obtaining one or more annotations associated with the at least one video based on the plurality of annotation tracks.Type: ApplicationFiled: March 10, 2020Publication date: September 16, 2021Applicant: Sony CorporationInventors: Gary Lyons, Kenji Suzuki, Brent Faust, Kevin Barnes, Jong Hwa Lee
-
Publication number: 20200320719Abstract: Implementations generally relate to determining a kinematic sequence. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes converting two-dimensional (2D) coordinates of the plurality of points to three-dimensional (3D) coordinates, where the converting is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates.Type: ApplicationFiled: September 20, 2019Publication date: October 8, 2020Applicant: Sony CorporationInventors: Jong Hwa Lee, Brent Faust, Kenji Suzuki, Arun Chandrasekar, Joseph Moon, Xihe Zhang
-
Publication number: 20200320283Abstract: Implementations generally relate to determining golf swing characteristics. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes determining a plurality of three-dimensional (3D) coordinates for each point of the plurality of points, where the determining of the 3D coordinates is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates. The method further includes determining one or more movement errors based at least in part on the movement of the plurality of points.Type: ApplicationFiled: September 20, 2019Publication date: October 8, 2020Applicant: Sony CorporationInventors: Jong Hwa Lee, Brent Faust, Kenji Suzuki, Arun Chandrasekar, Joseph Moon, Xihe Zhang