Abstract: A method, system and product includes capturing a noisy audio signal from an environment of a user, a plurality of people is located in the environment, the user having a mobile device used for obtaining user input, the user having at least one hearable device used for providing audio output to the user; applying speech separation on the noisy audio signal to obtain a separate audio signal that represents a voice of an unidentified entity; estimating an identifier of the unidentified entity, thereby obtaining an estimated identifier of the unidentified entity; and prompting the user to confirm or decline the estimated identifier.

Abstract: A method, system and product includes displaying to a user, via a mobile device, a map view depicting locations of at least a portion of a plurality of people relative to a location of the user, wherein the user and the plurality of people are located in an environment, the user having the mobile device used for obtaining user input, the user having a hearable device used for providing audio output to the user; receiving, via the mobile device, an activation selection of a target person from the map view; capturing a noisy audio signal from the environment; processing the noisy audio signal by applying speech separation on the target person, whereby generating an enhanced audio signal; and outputting to the user via the hearable device the enhanced audio signal.

Abstract: A method, system and product includes obtaining a first activation selection of a first person in an environment of a user, the environment comprising the first person and a second person, the user having a mobile device and a hearable device; capturing a first signal from the environment; applying speech separation on the first signal to extract a first audio signal associated with the first person; outputting to the user via the hearable device, a first output signal comprising the first audio signal; obtaining a second activation selection of the second person; capturing a second signal from the environment; applying speech separation on the second signal to extract a second audio signal associated with the second person; and outputting to the user, via the hearable device, a second output signal comprising the second audio signal.

Abstract: A method, system and product includes capturing a noisy audio signal from an environment of a user in which a plurality of people participate in a conversation, the plurality of people comprising a person, the noisy audio signal includes audio emitted by a non-human object and audio emitted by the person; applying speech separation on the noisy audio signal to obtain a separate audio signal that represents a sound-of-interest, the separate audio signal is based on the audio emitted by the non-human object; generating an enhanced audio signal based on the separate audio signal, wherein said generating comprises ensuring that the separate audio signal is present in the enhanced audio signal; and outputting the enhanced audio signal to the user via at least one hearable device.

Abstract: A method, system and product includes capturing a noisy audio signal from an environment of a user, a plurality of people is located in the environment, the user having a mobile device used for obtaining user input, the user having at least one hearable device used for providing audio output to the user, the method comprising; processing the noisy audio signal to generate a first separate audio signal that represents a first voice, and a second separate audio signal that represents a second voice, said processing is performed based on first and second acoustic fingerprints that correspond to the first and second voices, respectively; combining the first and second separate audio signals to obtain an enhanced audio signal; and outputting to the user, via the at least one hearable device, the enhanced audio signal.

Abstract: A system may include a wearable camera configured to capture images and a microphone configured to capture sounds. The system may also include a processor programmed to receive audio signals from the microphone and detect, based on analysis of the audio signals, a first audio signal associated with a first time period. The first audio signal may be representative of a voice of a single individual. The processor may also be programmed to detect, based on analysis of the audio signals, a second audio signal associated with a second time period. The second time period may be different from the first time period, and the second audio signal may be representative of overlapping voices of two or more individuals. The processor may further be programmed to selectively condition the first and second audio signals, and cause transmission of the conditioned first audio signal to a hearing interface device.

Abstract: Systems and methods for amplifying and/or attenuating audio signals are disclosed. In one implementation, a system for selectively amplifying audio signals may include at least one microphone for capturing sounds from an environment of the user and a processor. The processor may be programmed to receive an audio signal representative of sounds captured by the at least one microphone; determine whether the audio signal comprises speech by a user of the system; subject to the audio signal comprising speech by the user, modify the audio signal by attenuating a first part of the audio signal comprising the speech by the user; subject to the audio signal comprising audio other than speech by the user, modify the audio signal by amplifying a second part of the audio signal comprising audio other than the speech by the user; and transmit the modified audio signal to a hearing interface device.

Abstract: System and methods for processing audio signals are disclosed. In one implementation, a system may include at least one microphone configured to capture sounds from an environment of a user; and at least one processor. The processor may be programmed to receive at least one audio signal representative of at least part of the sounds captured by the microphone; identify at least one word in the at least one audio signal; and in response to identifying the at least one word, cause feedback to be provided the user.

Abstract: A system for selectively amplifying audio signals may include a wearable camera configured to capture a plurality of images from an environment of a user and a microphone configured to capture sounds from an environment of the user. The system may also include a processor programmed to: receive the plurality of images captured by the camera; identify a representation of at least one recognized individual in at least one of the plurality of images; receive audio signals representative of the sounds captured by the microphone; cause selective conditioning of at least one audio signal received by the microphone from a region associated with the at least one recognized individual; and cause transmission of the at least one conditioned audio signal to a hearing interface device configured to provide sound to an ear of the user.

Abstract: Embodiments are provided for a system comprising a camera, a microphone, and at least one processor programmed to execute a method, which may include: identifying at least one individual speaker in a first environment of a user; applying a voice classification model to classify at least a portion of an audio signal into one of a plurality of voice classifications based on at least one voice characteristic, the voice classifications denoting an emotional state of the at least one individual speaker; applying a context classification model to classify the first environment of the user into one of a plurality of contexts; associating, in at least one database, the at least one individual speaker with the voice classification, and the context classification of the first environment; and providing, to the user, at least one of an audible, visible, or tactile indication of the association.

Abstract: A system for selectively amplifying audio signals may include a microphone configured to capture sounds from an environment of a user. The system may also include a processor programmed to: receive audio signals representative of the sounds captured by the microphone; cause selective conditioning of at least one audio signal received by the microphone from a region associated with the recognized individual; and cause transmission of the at least one conditioned audio signal to a hearing interface device configured to provide sound to an ear of the user.

Abstract: A hearing aid and related systems and methods are disclosed. In one implementation, a system may comprise a microphone and a processor. The processor may be configured to receive an original audio signal representative of sounds captured by the microphone; determine that the original audio signal includes a voice of the user; process the original audio signal according to a first processing scheme to generate a first processed audio signal; transmit the first processed audio signal to a hearing interface device after a first time delay associated with the first processing scheme; determine that the original audio signal includes an additional sound; process the original audio signal according to a second processing scheme to generate a second processed audio signal; and transmit the second processed audio signal to the hearing interface device after a second time delay associated with the second processing scheme.

Abstract: A hearing aid system for individual identification of a hearing aid system may include a wearable camera, a microphone, and at least one processor. The processor may be programmed to receive a plurality of images captured by the wearable camera; receive audio signals representative of sounds captured by the microphone; and identify a first audio signal, from among the received audio signals, representative of a voice of a first individual. The processor may transcribe and store, in a memory, text corresponding to speech associated with the voice of the first individual and determine whether the first individual is a recognized individual. If the first individual is a recognized individual, the processor may associate an identifier of the first recognized individual with the stored text corresponding to the speech associated with the voice of the first individual.

Abstract: A system for generating processed audio signals may include an earphone comprising a microphone configured to capture sounds from an environment of the earphone, a first communication component, and a first processor; and an earphone case comprising an earphone compartment configured to receive the earphone, a second communication component, and a second processor. The first processor may be programmed to receive a captured audio signal representative of the sounds captured by the microphone; and transmit the captured audio signal via the first communication component. The second processor may be programmed to receive the captured audio signal via the second communication component; generate a processed audio signal based on analysis of the captured audio signal; and transmit the processed audio signal via the second communication component to the first communication component.

Abstract: A method for adjusting an audio transmission when a user of the system is being spoken to by another person includes receiving audio signals representative of sounds from an environment of the user captured by at least one microphone; determining at least from the received audio signals that the another person is speaking to user; and subject to the user being spoken to by the another person, adjusting the audio transmission to the user and signaling to the user that the user is being spoken to.

Abstract: System and methods for processing audio signals are disclosed. In one implementation, a system may include a wearable device. The wearable device may include a microphone having an audio sensor configured to capture the audio signals from an environment of the user; and a processor. The processor may be programmed to receive the audio signals captured by the microphone; analyze the audio signals to generate a transcription; generate a summary of the transcription; cause the summary to be displayed to the user; receive a confirmation input from the user indicating that the displayed summary is correct; and cause the displayed summary to be stored.

Abstract: Systems and methods are disclosed for selectively reading text. A system may comprise an image capture device, an audio capture device, and a processor. The processor may be configured to receive images captured by the image capture device and audio signals captured by the audio capture device. The processor may analyze the image to identify text represented in the image; identify, based on the image, a structural element of the text; identify a request to read a first portion of the text associated with the structural element, the request being identified by at least one of analyzing the audio signals to detect a spoken request or detecting a gesture in the plurality of images; and present the first portion of text to the user of the wearable device.

Abstract: A method for responding to a user query based on captured images and audio. An audio signal captured by at least one microphone is analyzed to determine at least one word. At least one image captured by at least one image sensor is analyzed to determine at least one identifier of at least one of a person, an object, a location, or an event represented in the image. The at least one word and the at least one identifier are stored in a database. A question is received from the user and is analyzed to determine at least one term. The database is searched to determine a correlation between the at least one term and the at least one word or between the at least one term and the at least one identifier. A response to the question is generated based on the correlation and is provided to the user.

Abstract: A hearing aid and related systems and methods are disclosed. In one implementation, a hearing aid system may include a wearable camera; a microphone; and a processor. The processor may be programmed to receive images captured by the camera; receive audio signals representative of sounds received by the at least one microphone; determine a look direction of the user based on analysis of the images; determine an amplitude of a first audio signal associated with an individual or object in a region associated with the look direction of the user; determine an amplitude of a second audio signal from a region other than the look direction of the user; adjust the second amplitude in accordance with the first amplitude; and cause transmission of the second audio signal at the adjusted amplitude to a hearing interface device configured to provide sound to an ear of the user.

Abstract: A hearing aid and related systems and methods are disclosed. In one implementation, a system may comprise a microphone, a wearable camera, and a processor. The processor may be configured to receive a composite audio signal representative of sounds captured by the microphone, the composite audio signal including a representation of an audio source and additional audio source in the environment of the user; obtain an indication of a direction of arrival associated with the audio source, the direction of arrival representing a position of the audio source relative to the user; provide the composite audio signal, information associated with the plurality of images, and the indication of the direction of arrival to a trained model; and extract, based on an output from the trained model, an isolated audio signal from the composite audio signal, the isolated audio signal representing sounds emanating from the audio source.