Patents by Inventor Daniel C. Klingler

Daniel C. Klingler has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11941968
    Abstract: An electronic device includes a processor, and a memory containing instructions that, when executed by the processor, cause the electronic device to learn a sound emitted by a legacy device and to issue an output when the electronic device subsequently hears the sound. For example, the electronic device can receive a training input and extract a compact representation of a sound in the training input, which the device stores. The device can receive an audio signal corresponding to an observed acoustic scene and extract a representation of the observed acoustic scene from the audio signal. The electronic device can determine whether the sound is present in the observed acoustic scene at least in part from a comparison of the representation of the observed acoustic scene with the representation of the sound. The electronic device emits a selected output responsive to determining that the sound is present in the acoustic scene.
    Type: Grant
    Filed: January 30, 2023
    Date of Patent: March 26, 2024
    Assignee: Apple Inc.
    Inventors: Hyung-Suk Kim, Daniel C. Klingler, Miquel Espi Marques, Carlos M. Avendano
  • Publication number: 20230394953
    Abstract: Techniques for monitoring an audio stream for triggering events are disclosed, where the triggering events may include a particular sound identified in the audio stream. In addition, the techniques include detecting the particular sound in the audio stream and/or providing an event notification to a user device via a network connection. A user device can request permission to initiate a two-way audio stream between the computing device and the user device. Further, the techniques may include receiving an indication to initiate the two-way audio stream with the user device. In addition, the techniques may include providing an alert that permission has been granted to initiate the two-way audio stream. Also, the device may include initiating the two-way audio stream with the user device.
    Type: Application
    Filed: April 24, 2023
    Publication date: December 7, 2023
    Applicant: Apple Inc.
    Inventors: Daniel C. Klingler, John A. Aguilar, Benjamin M. Weinshel, Jason J. Olson, Russell S. Greer, Hendrik Dahlkamp, Miraj Hassanpur, Kevin V. Bender, Sasanka T. Vemuri
  • Publication number: 20230360641
    Abstract: The subject disclosure provides systems and methods for generating and storing learned embeddings of audio inputs to an electronic device. The electronic device may generate and store encoded versions of audio inputs and learned embeddings of the audio inputs. When a new audio input is obtained, the electronic device can generate an encoded version of the new audio input, compare the encoded version of the new audio input to the stored encoded versions of prior audio inputs, and if the encoded version of the new audio input matches one of the stored encoded versions of the prior audio inputs, the electronic device can provide a stored learned embedding that corresponds to the one of the stored encoded versions of the prior audio inputs to a detection model at the electronic device. The cached embeddings can be provided to locally trained models for detecting individual sounds using electronic devices.
    Type: Application
    Filed: May 4, 2022
    Publication date: November 9, 2023
    Inventors: Daniel C. KLINGLER, Carlos M. AVENDANO, Jonathan HUANG, Miquel ESPI MARQUES
  • Publication number: 20230186904
    Abstract: An electronic device has one or more microphones that pick up a sound. At least one feature extractor processes the audio signals from the microphones, that contain the picked up the sound, to determine several features for the sound. The electronic device also includes a classifier that has a machine learning model which is configured to determine a sound classification, such as artificial versus natural for the sound, based upon at least one of the determined features. Other aspects are also described and claimed.
    Type: Application
    Filed: November 22, 2022
    Publication date: June 15, 2023
    Inventors: Daniel C. Klingler, Carlos M. Avendano, Hyung-Suk Kim, Miquel Espi Marques
  • Publication number: 20230177942
    Abstract: An electronic device includes a processor, and a memory containing instructions that, when executed by the processor, cause the electronic device to learn a sound emitted by a legacy device and to issue an output when the electronic device subsequently hears the sound. For example, the electronic device can receive a training input and extract a compact representation of a sound in the training input, which the device stores. The device can receive an audio signal corresponding to an observed acoustic scene and extract a representation of the observed acoustic scene from the audio signal. The electronic device can determine whether the sound is present in the observed acoustic scene at least in part from a comparison of the representation of the observed acoustic scene with the representation of the sound. The electronic device emits a selected output responsive to determining that the sound is present in the acoustic scene.
    Type: Application
    Filed: January 30, 2023
    Publication date: June 8, 2023
    Inventors: Hyung-Suk KIM, Daniel C. KLINGLER, Miquel ESPI MARQUES, Carlos M. AVENDANO
  • Patent number: 11568731
    Abstract: An electronic device includes a processor, and a memory containing instructions that, when executed by the processor, cause the electronic device to learn a sound emitted by a legacy device and to issue an output when the electronic device subsequently hears the sound. For example, the electronic device can receive a training input and extract a compact representation of a sound in the training input, which the device stores. The device can receive an audio signal corresponding to an observed acoustic scene and extract a representation of the observed acoustic scene from the audio signal. The electronic device can determine whether the sound is present in the observed acoustic scene at least in part from a comparison of the representation of the observed acoustic scene with the representation of the sound. The electronic device emits a selected output responsive to determining that the sound is present in the acoustic scene.
    Type: Grant
    Filed: May 11, 2020
    Date of Patent: January 31, 2023
    Assignee: APPLE INC.
    Inventors: Hyung-Suk Kim, Daniel C. Klingler, Miquel Espi Marques, Carlos M. Avendano
  • Publication number: 20220391758
    Abstract: The subject disclosure provides systems and methods for providing locally trained models for detecting individual sounds using electronic devices. Local detection of individual sounds with a detection model at an electronic device can be provided by obtaining training samples for the detection model with the electronic device, and generating additional negative and positive training samples based on the obtained training samples. A two-stage detection process may be provided, in which a trigger model at a device compares an audio input to a reference sound to trigger a detection model at the device. The detection of individual sounds with a detection model at an electronic device can also leverage audio capture capabilities of multiple devices in an acoustic scene to capture multiple concurrent training samples.
    Type: Application
    Filed: May 4, 2022
    Publication date: December 8, 2022
    Inventors: Jonathan HUANG, Miquel ESPI MARQUES, Carlos M. AVENDANO, Kevin M. DURAND, David FINDLAY, Vasudha KOWTHA, Daniel C. KLINGLER, Yichi ZHANG
  • Patent number: 11521598
    Abstract: An electronic device has one or more microphones that pick up a sound. At least one feature extractor processes the audio signals from the microphones, that contain the picked up the sound, to determine several features for the sound. The electronic device also includes a classifier that has a machine learning model which is configured to determine a sound classification, such as artificial versus natural for the sound, based upon at least one of the determined features. Other aspects are also described and claimed.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: December 6, 2022
    Assignee: APPLE INC.
    Inventors: Daniel C. Klingler, Carlos M. Avendano, Hyung-Suk Kim, Miquel Espi Marques
  • Patent number: 11514921
    Abstract: A system and method to process audio data received over the ARC or eARC interface of HDMI from audio sources are provided. A media device may receive compressed audio data in a number of data formats. The media device may convert between the audio formats provided by the audio sources and the audio formats supported by audio playback devices. The media device may inspect frames of audio data to determine if the frames are to be decoded. The frame may be decoded and subsequently encoded into the data formats supported by the audio playback devices. To reduce latency, the media device may enable a pass-through mode to bypass the decoding of the frames to allow the frames to be decoded at the audio playback devices. A bi-directional loopback application may route audio data received over the ARC or eARC interface from the audio sources to the audio playback devices.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: November 29, 2022
    Assignee: APPLE INC.
    Inventors: Brett D. George, Adam E. Kriegel, Michael F. Jean, Daniel C. Klingler, Girault W. Jones, Felipe Ferreri Tonello
  • Publication number: 20210392129
    Abstract: The embodiments set forth a technique for enabling a computing device to securely configure a peripheral computing device. According to some embodiments, the method can include the steps of (1) approving a request received from the peripheral computing device to engage in a setup procedure for the peripheral computing device, (2) receiving, from the peripheral computing device: (i) an audio signal that encodes a password and timing information, and (ii) a light signal. Additionally, the method can involve, in response to identifying that the timing information correlates with the light signal: (3) extracting the password from the audio signal, and (4) establishing a communication link with the peripheral computing device based on the password. In turn, the method can involve (5) providing configuration information to the peripheral computing device over the communication link.
    Type: Application
    Filed: June 23, 2021
    Publication date: December 16, 2021
    Inventors: Jay S. COGGIN, Daniel C. KLINGLER, Kyle C. BROGLE, Johannes P. SCHMIDT, Eric A. ALLAMANCHE, Thomas ALSINA, Bob BRADLEY, Alex T. NELSON, Rudolph VAN DER MERWE, Joseph M. TRISCARI, Keun Sup LEE, Pedro MARI, Aaron M. ELDER, Richard M. POWELL
  • Patent number: 11070676
    Abstract: Techniques to use an embedded passcode within an audio ringtone to establish a secure connection for arbitrary phone relay are described. The use of an embedded passcode enables encrypted ad-hoc connections for the relay of audio of an incoming telephone call to a secondary device, such as a virtual assistant enabled smart speaker device.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: July 20, 2021
    Assignee: Apple Inc.
    Inventors: Daniel C. Klingler, David L. Biderman, Nicholas M. Fraioli, Christopher M. Garrido, Adam E. Kriegel, Shuang Liu, Richard M. Powell
  • Patent number: 11050737
    Abstract: The embodiments set forth a technique for enabling a computing device to securely configure a peripheral computing device. According to some embodiments, the method can include the steps of (1) approving a request received from the peripheral computing device to engage in a setup procedure for the peripheral computing device, (2) receiving, from the peripheral computing device: (i) an audio signal that encodes a password and timing information, and (ii) a light signal. Additionally, the method can involve, in response to identifying that the timing information correlates with the light signal: (3) extracting the password from the audio signal, and (4) establishing a communication link with the peripheral computing device based on the password. In turn, the method can involve (5) providing configuration information to the peripheral computing device over the communication link.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: June 29, 2021
    Assignee: Apple Inc.
    Inventors: Jay S. Coggin, Daniel C. Klingler, Kyle C. Brogle, Johannes P. Schmidt, Eric A. Allamanche, Thomas Alsina, Bob Bradley, Alex T. Nelson, Rudolph Van Der Merwe, Joseph M. Triscari, Keun Sup Lee, Pedro Mari, Aaron M. Elder, Richard M. Powell
  • Patent number: 11025406
    Abstract: A system and method to mitigate the temporary loss of the input sampling clocks when receiving audio data over the ARC or eARC interface of HDMI are provided. A media device may substitute an externally generated clock derived from a local crystal oscillator of the media device for the missing input sampling clock. The external clock may be synchronized to the frequency of the input sampling clock. The media device may synchronize the external clock to the audio data when there is a loss of the input sampling clock. When the input sampling clock of the audio data reappears, the media device may switch back from the external clock to the input sampling clock. When transitioning between the input sampling clock and the external clock, the media device may insert zero padding into the audio data samples to mute any potential glitch in the sound from an audio playback device.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: June 1, 2021
    Assignee: Apple Inc.
    Inventors: Michael F. Jean, Adam E. Kriegel, Brett D. George, Daniel C. Klingler, Girault W. Jones, Felipe Ferreri Tonello
  • Publication number: 20210099278
    Abstract: A system and method to mitigate the temporary loss of the input sampling clocks when receiving audio data over the ARC or eARC interface of HDMI are provided. A media device may substitute an externally generated clock derived from a local crystal oscillator of the media device for the missing input sampling clock. The external clock may be synchronized to the frequency of the input sampling clock. The media device may synchronize the external clock to the audio data when there is a loss of the input sampling clock. When the input sampling clock of the audio data reappears, the media device may switch back from the external clock to the input sampling clock. When transitioning between the input sampling clock and the external clock, the media device may insert zero padding into the audio data samples to mute any potential glitch in the sound from an audio playback device.
    Type: Application
    Filed: September 26, 2019
    Publication date: April 1, 2021
    Inventors: Michael F. Jean, Adam E. Kriegel, Brett D. George, Daniel C. Klingler, Girault W. Jones, Felipe Ferreri Tonello
  • Publication number: 20210098011
    Abstract: A system and method to process audio data received over the ARC or eARC interface of HDMI from audio sources are provided. A media device may receive compressed audio data in a number of data formats. The media device may convert between the audio formats provided by the audio sources and the audio formats supported by audio playback devices. The media device may inspect frames of audio data to determine if the frames are to be decoded. The frame may be decoded and subsequently encoded into the data formats supported by the audio playback devices. To reduce latency, the media device may enable a pass-through mode to bypass the decoding of the frames to allow the frames to be decoded at the audio playback devices. A bi-directional loopback application may route audio data received over the ARC or eARC interface from the audio sources to the audio playback devices.
    Type: Application
    Filed: September 26, 2019
    Publication date: April 1, 2021
    Inventors: Brett D. George, Adam E. Kriegel, Michael F. Jean, Daniel C. Klingler, Girault W. Jones, Felipe Ferreri Tonello
  • Publication number: 20210020018
    Abstract: An electronic device includes a processor, and a memory containing instructions that, when executed by the processor, cause the electronic device to learn a sound emitted by a legacy device and to issue an output when the electronic device subsequently hears the sound. For example, the electronic device can receive a training input and extract a compact representation of a sound in the training input, which the device stores. The device can receive an audio signal corresponding to an observed acoustic scene and extract a representation of the observed acoustic scene from the audio signal. The electronic device can determine whether the sound is present in the observed acoustic scene at least in part from a comparison of the representation of the observed acoustic scene with the representation of the sound. The electronic device emits a selected output responsive to determining that the sound is present in the acoustic scene.
    Type: Application
    Filed: May 11, 2020
    Publication date: January 21, 2021
    Inventors: Hyung-Suk Kim, Daniel C. Klingler, Miquel Espi Marques, Carlos M. Avendano
  • Patent number: 10856018
    Abstract: Methods and systems provide control of media synchronization using time stamp pairs. In an embodiment, a first device may request a time stamp from a second device. The first device may determine any de-synchronization between the first and second devices based on the requested time stamp and characteristics of the request. The first device may define a rate scalar based on the determined de-synchronization. A sample rate conversion may be performed for the first device based on the rate scalar such that the outputs of the first device and the second device are synchronized.
    Type: Grant
    Filed: February 17, 2017
    Date of Patent: December 1, 2020
    Assignee: APPLE INC.
    Inventors: Richard M. Powell, Ashley I. Butterworth, Anthony J. Guetta, Daniel C. Klingler, Jeffrey C. Moore, Alexander C. Powers
  • Publication number: 20200314247
    Abstract: Techniques to use an embedded passcode within an audio ringtone to establish a secure connection for arbitrary phone relay are described. The use of an embedded passcode enables encrypted ad-hoc connections for the relay of audio of an incoming telephone call to a secondary device, such as a virtual assistant enabled smart speaker device.
    Type: Application
    Filed: March 25, 2020
    Publication date: October 1, 2020
    Inventors: Daniel C. Klingler, David L. Biderman, Nicholas M. Fraioli, Christopher M. Garrido, Adam E. Kriegel, Shuang Liu, Richard M. Powell
  • Publication number: 20200090644
    Abstract: An electronic device has one or more microphones that pick up a sound. At least one feature extractor processes the audio signals from the microphones, that contain the picked up the sound, to determine several features for the sound. The electronic device also includes a classifier that has a machine learning model which is configured to determine a sound classification, such as artificial versus natural for the sound, based upon at least one of the determined features. Other aspects are also described and claimed.
    Type: Application
    Filed: September 9, 2019
    Publication date: March 19, 2020
    Inventors: Daniel C. Klingler, Carlos M. Avendano, Hyung-Suk Kim, Miquel Espi Marques
  • Publication number: 20200076788
    Abstract: The embodiments set forth a technique for enabling a computing device to securely configure a peripheral computing device. According to some embodiments, the method can include the steps of (1) approving a request received from the peripheral computing device to engage in a setup procedure for the peripheral computing device, (2) receiving, from the peripheral computing device: (i) an audio signal that encodes a password and timing information, and (ii) a light signal. Additionally, the method can involve, in response to identifying that the timing information correlates with the light signal: (3) extracting the password from the audio signal, and (4) establishing a communication link with the peripheral computing device based on the password. In turn, the method can involve (5) providing configuration information to the peripheral computing device over the communication link.
    Type: Application
    Filed: September 23, 2019
    Publication date: March 5, 2020
    Inventors: Jay S. COGGIN, Daniel C. KLINGLER, Kyle C. BROGLE, Johannes P. SCHMIDT, Eric A. ALLAMANCHE, Thomas ALSINA, Bob BRADLEY, Alex T. NELSON, Rudolph VAN DER MERWE, Joseph M. TRISCARI, Keun Sup LEE, Pedro MARI, Aaron M. ELDER, Richard M. POWELL