Patents by Inventor Zhinian Jing

Zhinian Jing has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230379621
    Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.
    Type: Application
    Filed: April 4, 2023
    Publication date: November 23, 2023
    Inventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
  • Patent number: 11627413
    Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.
    Type: Grant
    Filed: November 5, 2012
    Date of Patent: April 11, 2023
    Assignee: Jawbone Innovations, LLC
    Inventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
  • Publication number: 20220247894
    Abstract: A camera includes a first microphone, a second microphone, one or more drains, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The one or more drains drain water away from the first microphone, the second microphone, or both. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.
    Type: Application
    Filed: April 22, 2022
    Publication date: August 4, 2022
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 11343413
    Abstract: A camera includes a first microphone, a second microphone, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.
    Type: Grant
    Filed: September 4, 2020
    Date of Patent: May 24, 2022
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 10944936
    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.
    Type: Grant
    Filed: August 26, 2019
    Date of Patent: March 9, 2021
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Joyce Rosenbaum
  • Publication number: 20200404126
    Abstract: A camera includes a first microphone, a second microphone, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.
    Type: Application
    Filed: September 4, 2020
    Publication date: December 24, 2020
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 10771660
    Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: September 8, 2020
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 10679676
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: June 9, 2020
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Publication number: 20200135238
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Application
    Filed: December 19, 2019
    Publication date: April 30, 2020
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Patent number: 10573351
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: February 25, 2020
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Publication number: 20200021771
    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.
    Type: Application
    Filed: August 26, 2019
    Publication date: January 16, 2020
    Inventors: Zhinian Jing, Joyce Rosenbaum
  • Publication number: 20190364177
    Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.
    Type: Application
    Filed: June 13, 2019
    Publication date: November 28, 2019
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Publication number: 20190325915
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Application
    Filed: June 28, 2019
    Publication date: October 24, 2019
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Patent number: 10425610
    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.
    Type: Grant
    Filed: October 8, 2018
    Date of Patent: September 24, 2019
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Joyce Rosenbaum
  • Patent number: 10410680
    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: September 10, 2019
    Assignee: GoPro, Inc.
    Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
  • Patent number: 10362199
    Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.
    Type: Grant
    Filed: August 10, 2017
    Date of Patent: July 23, 2019
    Assignee: GoPro, Inc.
    Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
  • Patent number: 10230346
    Abstract: Techniques for acoustic voice activity detection (AVAD) is described, including detecting a signal associated with a subband from a microphone, performing an operation on data associated with the signal, the operation generating a value associated with the subband, and determining whether the value distinguishes the signal from noise by using the value to determine a signal-to-noise ratio and comparing the value to a threshold.
    Type: Grant
    Filed: January 9, 2012
    Date of Patent: March 12, 2019
    Inventor: Zhinian Jing
  • Patent number: 10218853
    Abstract: A wireless conference call telephone system uses body-worn wired or wireless audio endpoints comprising microphones and, optionally, speakers. These audio-endpoints, which include headsets, pendants, and clip-on microphones to name a few, are used to capture the user's voice and the resulting data may be used to remove echo and environmental acoustic noise. Each audio-endpoint transmits its audio to the telephony gateway, where noise and echo suppression can take place if not already performed on the audio-endpoint, and where each audio-endpoint's output can be labeled, integrated with the output of other audio-endpoints, and transmitted over one or more telephony channels of a telephone network. The noise and echo suppression can also be done on the audio-endpoint. The labeling of each user's output can be used by the outside caller's phone to spatially locate each user in space, increasing intelligibility.
    Type: Grant
    Filed: July 15, 2011
    Date of Patent: February 26, 2019
    Inventors: Gregory C. Burnett, Michael Goertz, Nicolas Jean Petit, Zhinian Jing, Steven Foster Forestieri, Thomas Alan Donaldson
  • Patent number: 10218327
    Abstract: Various embodiments relate to signal processing and, more particularly, to processing of received speech signals to preserve and enhance speech intelligibility. In one embodiment, a communications apparatus includes a receiving path over which received speech signals traverse in an audio stream, and an dynamic audio enhancement device disposed in the receiving path. The dynamic audio enhancement (“DAE”) device is configured to modify an amount of volume and an amount of equalization of the audio stream. The DAE device can include a noise level estimator (“NLE”) configured to generate a signal representing a noise level estimate. The noise level estimator can include a non-stationary noise detector and a stationary noise detector. The noise level estimator can be configured to generate the signal representing a first noise level estimate based on detection of the non-stationary noise or a second noise level estimate based on detection of the stationary noise.
    Type: Grant
    Filed: January 9, 2012
    Date of Patent: February 26, 2019
    Inventor: Zhinian Jing
  • Publication number: 20190052835
    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.
    Type: Application
    Filed: October 8, 2018
    Publication date: February 14, 2019
    Inventors: Zhinian Jing, Joyce Rosenbaum