Patents by Inventor Zhinian Jing
Zhinian Jing has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250097635Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.Type: ApplicationFiled: July 31, 2024Publication date: March 20, 2025Inventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
-
Patent number: 12088894Abstract: A camera includes a first microphone, a second microphone, one or more drains, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The one or more drains drain water away from the first microphone, the second microphone, or both. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.Type: GrantFiled: April 22, 2022Date of Patent: September 10, 2024Assignee: GoPro, Inc.Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
-
Patent number: 12063487Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.Type: GrantFiled: April 4, 2023Date of Patent: August 13, 2024Assignee: Jawbone Innovations, LLCInventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
-
Publication number: 20230379621Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.Type: ApplicationFiled: April 4, 2023Publication date: November 23, 2023Inventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
-
Patent number: 11627413Abstract: Acoustic Voice Activity Detection (AVAD) methods and systems are described. The AVAD methods and systems, including corresponding algorithms or programs, use microphones to generate virtual directional microphones which have very similar noise responses and very dissimilar speech responses. The ratio of the energies of the virtual microphones is then calculated over a given window size and the ratio can then be used with a variety of methods to generate a VAD signal. The virtual microphones can be constructed using either an adaptive or a fixed filter.Type: GrantFiled: November 5, 2012Date of Patent: April 11, 2023Assignee: Jawbone Innovations, LLCInventors: Nicolas Petit, Gregory Burnett, Zhinian Jing
-
Publication number: 20220247894Abstract: A camera includes a first microphone, a second microphone, one or more drains, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The one or more drains drain water away from the first microphone, the second microphone, or both. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.Type: ApplicationFiled: April 22, 2022Publication date: August 4, 2022Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
-
Patent number: 11343413Abstract: A camera includes a first microphone, a second microphone, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.Type: GrantFiled: September 4, 2020Date of Patent: May 24, 2022Assignee: GoPro, Inc.Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
-
Patent number: 10944936Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.Type: GrantFiled: August 26, 2019Date of Patent: March 9, 2021Assignee: GoPro, Inc.Inventors: Zhinian Jing, Joyce Rosenbaum
-
Publication number: 20200404126Abstract: A camera includes a first microphone, a second microphone, and a processor. The processor determines a correlation metric between portions of audio signals obtained from the first and second microphones. The camera includes a memory to store the portions of the audio signals as portions of an output audio signal.Type: ApplicationFiled: September 4, 2020Publication date: December 24, 2020Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
-
Patent number: 10771660Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.Type: GrantFiled: June 13, 2019Date of Patent: September 8, 2020Assignee: GoPro, Inc.Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
-
Patent number: 10679676Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.Type: GrantFiled: December 19, 2019Date of Patent: June 9, 2020Assignee: GoPro, Inc.Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
-
Publication number: 20200135238Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.Type: ApplicationFiled: December 19, 2019Publication date: April 30, 2020Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
-
Patent number: 10573351Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.Type: GrantFiled: June 28, 2019Date of Patent: February 25, 2020Assignee: GoPro, Inc.Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
-
Publication number: 20200021771Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.Type: ApplicationFiled: August 26, 2019Publication date: January 16, 2020Inventors: Zhinian Jing, Joyce Rosenbaum
-
Publication number: 20190364177Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.Type: ApplicationFiled: June 13, 2019Publication date: November 28, 2019Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
-
Publication number: 20190325915Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.Type: ApplicationFiled: June 28, 2019Publication date: October 24, 2019Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
-
Patent number: 10425610Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.Type: GrantFiled: October 8, 2018Date of Patent: September 24, 2019Assignee: GoPro, Inc.Inventors: Zhinian Jing, Joyce Rosenbaum
-
Patent number: 10410680Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.Type: GrantFiled: August 20, 2018Date of Patent: September 10, 2019Assignee: GoPro, Inc.Inventors: Scott Patrick Campbell, Zhinian Jing, Timothy Macmillan, David A. Newman, Balineedu Chowdary Adsumilli
-
Patent number: 10362199Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.Type: GrantFiled: August 10, 2017Date of Patent: July 23, 2019Assignee: GoPro, Inc.Inventors: Zhinian Jing, Ke Li, Erich Tisch, Joyce Rosenbaum, Magnus Hansson
-
Patent number: 10230346Abstract: Techniques for acoustic voice activity detection (AVAD) is described, including detecting a signal associated with a subband from a microphone, performing an operation on data associated with the signal, the operation generating a value associated with the subband, and determining whether the value distinguishes the signal from noise by using the value to determine a signal-to-noise ratio and comparing the value to a threshold.Type: GrantFiled: January 9, 2012Date of Patent: March 12, 2019Inventor: Zhinian Jing