Patents by Inventor Ruohan Gao

Ruohan Gao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • SYSTEMS AND METHODS FOR VISUALLY GUIDED AUDIO SEPARATION
    Publication number: 20230223035
    Abstract: A system for separating audio based on sound producing objects includes a processor configured to receive video data and audio data. The processor is also configured to perform object detection using the video data to identify a number of sound producing objects in the video data and predict a separation for each sound producing object detected in the video data. The processor is also configured to generate separated audio data for each sound producing object using the separation and the audio data.
    Type: Application
    Filed: March 14, 2023
    Publication date: July 13, 2023
    Inventors: Kristen Lorraine Grauman, Ruohan Gao
  • Systems and methods for visually guided audio separation
    Patent number: 11610599
    Abstract: A system for separating audio based on sound producing objects includes a processor configured to receive video data and audio data. The processor is also configured to perform object detection using the video data to identify a number of sound producing objects in the video data and predict a separation for each sound producing object detected in the video data. The processor is also configured to generate separated audio data for each sound producing object using the separation and the audio data.
    Type: Grant
    Filed: December 6, 2019
    Date of Patent: March 21, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Kristen Lorraine Grauman, Ruohan Gao
  • SYSTEMS AND METHODS FOR VISUALLY GUIDED AUDIO SEPARATION
    Publication number: 20210174817
    Abstract: A system for separating audio based on sound producing objects includes a processor configured to receive video data and audio data. The processor is also configured to perform object detection using the video data to identify a number of sound producing objects in the video data and predict a separation for each sound producing object detected in the video data. The processor is also configured to generate separated audio data for each sound producing object using the separation and the audio data.
    Type: Application
    Filed: December 6, 2019
    Publication date: June 10, 2021
    Inventors: Kristen Lorraine Grauman, Ruohan Gao