Patents by Inventor Zhinian Jing

Zhinian Jing has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250097635
    Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.
    Type: Application
    Filed: July 31, 2024
    Publication date: March 20, 2025
    Inventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
  • Patent number: 12088894
    Abstract: A camera includes a first microphone, a second microphone, one or more drains, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The one or more drains drain water away from the first microphone, the second microphone, or both. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.
    Type: Grant
    Filed: April 22, 2022
    Date of Patent: September 10, 2024
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 12063487
    Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.
    Type: Grant
    Filed: April 4, 2023
    Date of Patent: August 13, 2024
    Assignee: Jawbone Innovations, LLC
    Inventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
  • Publication number: 20230379621
    Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.
    Type: Application
    Filed: April 4, 2023
    Publication date: November 23, 2023
    Inventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
  • Patent number: 11627413
    Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.
    Type: Grant
    Filed: November 5, 2012
    Date of Patent: April 11, 2023
    Assignee: Jawbone Innovations, LLC
    Inventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
  • Publication number: 20220247894
    Abstract: A camera includes a first microphone, a second microphone, one or more drains, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The one or more drains drain water away from the first microphone, the second microphone, or both. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.
    Type: Application
    Filed: April 22, 2022
    Publication date: August 4, 2022
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 11343413
    Abstract: A camera includes a first microphone, a second microphone, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.
    Type: Grant
    Filed: September 4, 2020
    Date of Patent: May 24, 2022
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 10944936
    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.
    Type: Grant
    Filed: August 26, 2019
    Date of Patent: March 9, 2021
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Joyce Rosenbaum
  • Publication number: 20200404126
    Abstract: A camera includes a first microphone, a second microphone, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.
    Type: Application
    Filed: September 4, 2020
    Publication date: December 24, 2020
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 10771660
    Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: September 8, 2020
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 10679676
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: June 9, 2020
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Publication number: 20200135238
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Application
    Filed: December 19, 2019
    Publication date: April 30, 2020
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Patent number: 10573351
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: February 25, 2020
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Publication number: 20200021771
    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.
    Type: Application
    Filed: August 26, 2019
    Publication date: January 16, 2020
    Inventors: Zhinian Jing, Joyce Rosenbaum
  • Publication number: 20190364177
    Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.
    Type: Application
    Filed: June 13, 2019
    Publication date: November 28, 2019
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Publication number: 20190325915
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Application
    Filed: June 28, 2019
    Publication date: October 24, 2019
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Patent number: 10425610
    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.
    Type: Grant
    Filed: October 8, 2018
    Date of Patent: September 24, 2019
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Joyce Rosenbaum
  • Patent number: 10410680
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: September 10, 2019
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Patent number: 10362199
    Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.
    Type: Grant
    Filed: August 10, 2017
    Date of Patent: July 23, 2019
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 10230346
    Abstract: Techniques for acoustic voice activity detection (AVAD) is described, including detecting a signal associated with a subband from a microphone, performing an operation on data associated with the signal, the operation generating a value associated with the subband, and determining whether the value distinguishes the signal from noise by using the value to determine a signal-to-noise ratio and comparing the value to a threshold.
    Type: Grant
    Filed: January 9, 2012
    Date of Patent: March 12, 2019
    Inventor: Zhinian Jing