Abstract: System and methods for processing audio signals are disclosed. In one implementation, a system may include a wearable apparatus including an image sensor to capture images from an environment of a user; an audio sensor to capture an audio signal from the environment of the user; and at least one processor. The processor may be programmed to receive the audio signal captured by the audio sensor; identify at least one segment including speech in the audio signal; receive an image including a representation of a code; analyze the code to determine whether the code is associated with the user and/or the wearable apparatus; and after determining that the code is associated with the user and/or the wearable apparatus, transmit at least one segment of the audio signal, at least one image of the plurality of images, and/or other information to a computing platform.

Abstract: A system may include a camera configured to capture images from an environment of a user and a microphone configured to capture sounds from an environment of the user. The system may also include a processor programmed to: receive the images; identify a representation of a first individual and a representation of a second individual in the images; receive, from the microphone, a first audio signal associated with a voice of the first individual and a second audio signal associated with a voice of the second individual; detect an amplification criteria indicative of a voice amplification priority between the first individual and the second individual; selectively amplify the first audio signal relative to the second audio signal when the amplification criteria indicates that the first individual has voice amplification priority over the second individual; and cause transmission of the selectively amplified first audio signal to a hearing interface device.

Abstract: A system may include a wearable camera configured to capture a plurality of images from an environment of a user and a microphone configured to capture sounds from an environment of the user. The system may also include a processor programmed to receive the images; identify a representation of one individual in one of the images; identify a lip movement associated with a mouth of the individual, based on analysis of the images; receive audio signals representative of the sounds; identify, based on analysis of the sounds, a first audio signal associated with a first voice and a second audio signal associated with a second voice; cause selective conditioning of the first audio signal based on a determination that the first audio signal is associated with the identified lip movement; and cause transmission of the selectively conditioned first audio signal to a hearing interface device.

Abstract: A wearable apparatus may automatically monitor consumption by a user of the wearable apparatus by analyzing images captured from an environment of the user. The wearable apparatus may include at least one image capture device configured to capture a plurality of images from an environment of the user of the wearable apparatus.

Abstract: Systems and methods are disclosed for using a wearable apparatus with overhead projection. In one implementation, a wearable apparatus may include an image sensor configured to capture a plurality of images from an environment of a user; a light projector; and at least one processor. The processor may be programmed to receive at least one image of the plurality of images; identify an item of information based on the at least one image; select a surface located within a field of view of the user; render the item of information into an informational image; and cause the projector to project the informational image onto the surface.

Abstract: A hearing aid and related systems and methods are disclosed. In one implementation, a system may comprise a microphone, a wearable camera, and a processor. The processor may be configured to receive a composite audio signal representative of sounds captured by the microphone, the composite audio signal including a representation of an audio source and additional audio source in the environment of the user; obtain an indication of a direction of arrival associated with the audio source, the direction of arrival representing a position of the audio source relative to the user; provide the composite audio signal, information associated with the plurality of images, and the indication of the direction of arrival to a trained model; and extract, based on an output from the trained model, an isolated audio signal from the composite audio signal, the isolated audio signal representing sounds emanating from the audio source.

Abstract: System and methods for selectively amplifying audio signals are disclosed. In one implementation, a method includes receiving at least one image of a plurality of images captured by a wearable camera; receiving a first audio signal representative of the sounds captured by a microphone; determining a looking direction of a user; and processing the first audio signal by amplifying audio coming from the looking direction of the user and attenuating audio coming from at least one other direction; receiving a second audio signal representative of the sounds captured by a hearing interface device; transmitting the second audio signal to a speaker associated with the hearing interface device; transmitting an additional audio signal to the speaker, wherein the transmission of the additional audio signal at least partially overlaps the transmission of the second audio signal; and transmitting the processed first audio signal to the speaker.

Abstract: System and methods for processing audio signals are disclosed. In one implementation, a system may include at least one microphone configured to capture sounds from an environment of a user; a wearable camera configured to capture a plurality of images from the environment of the user; and at least one processor. The processor may be configured to receive at least one image of the plurality of images; receive at least one audio signal representative of the sounds captured by the at least one microphone; identify an item of information based on at least one of the at least one image or the at least one audio signal; determine at least a beginning of an informational time period for providing the item of information to the user; and transmit an informational audio signal representative of the item of information to a hearing interface device during the informational time period.

Abstract: A wearable apparatus may include a processor programmed to receive an image from an image sensor. The processor may also programmed to receive sound data associated with the image, and determine a first spoken name and a second spoken name based on an analysis of the sound data. The processor may further programmed to determine a correlation between the first spoken name and a first individual, and a correlation between the second spoken name and a second individual, based on the image and the sound data. The processor may also programmed to convert the first spoken name to a first text and convert the second spoken name to a second text. The processor may further programmed to cause a database to store the first text in association with a facial image of the first individual and store the second text in association with a facial image of the second individual.

Abstract: A hearing aid system for selective modification of background noises may include at least one processor. The processor may be programmed to receive a plurality of images from an environment of a user captured by a wearable camera during a time period and receive an audio signal representative of sounds acquired by a wearable microphone during the time period. The processor may determine that at least one of the sounds was generated by a sound-emanating object in the environment of the user, but outside of a field of view of the wearable camera and retrieve from a database information associated with the sound-emanating object. Based on the retrieved information, the processor may cause selective conditioning of audio signals acquired by the wearable microphone during the time period and cause transmission of the conditioned audio signals to a hearing interface device configured to provide sounds to an ear of the user.

Abstract: A hearing aid and related systems and methods are disclosed. In one implementation, a system may comprise a microphone and a processor. The processor may be configured to receive an original audio signal representative of sounds captured by the microphone; determine that the original audio signal includes a voice of the user; process the original audio signal according to a first processing scheme to generate a first processed audio signal; transmit the first processed audio signal to a hearing interface device after a first time delay associated with the first processing scheme; determine that the original audio signal includes an additional sound; process the original audio signal according to a second processing scheme to generate a second processed audio signal; and transmit the second processed audio signal to the hearing interface device after a second time delay associated with the second processing scheme.

Abstract: A hearing aid and related systems and methods is disclosed. In one implementation, a system may comprise a microphone and a processor. The processor may be configured to receive an audio signal representative of sounds captured by the microphone; process a first sample period of the audio signal using a first engine; determine, based on the processing of the first sample period using the first engine, that the audio signal is not to be transmitted to a hearing interface device; process a second sample period of the audio signal using a second engine; determine, based on the processing of the second sample period using the second engine, that the audio signal is to be transmitted to the hearing interface device; and transmit at least a part of the first portion of the audio signal to the hearing interface device at an increased rate.

Abstract: Systems and methods for modifying audio signals based on context may include at least one microphone configured to capture sounds from an environment of a user; and at least one processor. The processor may be programmed to receive an audio signal representative of sounds captured by the at least one microphone; and determine a context associated with the captured sounds based on the audio signal. Subject to the context being included in a set of stored contexts, the processor may be programmed to determine at least one first speaker whose speech is to be amplified; identify at least one first portion of the audio signal associated with the determined at least one first speaker; amplify the at least one first portion of the audio signal; and transmit to a hearing interface device the amplified at least one first portion of the audio signal.

Abstract: Devices and a method are provided for providing feedback to a user. In one implementation, the method comprises obtaining a plurality of images from an image sensor. The image sensor is configured to be positioned for movement with the user's head. The method further comprises monitoring the images, and determining whether relative motion occurs between a first portion of a scene captured in the plurality of images and other portions of the scene captured in the plurality of images. If the first portion of the scene moves less than at least one other portion of the scene, the method comprises obtaining contextual information from the first portion of the scene. The method further comprises providing the feedback to the user based on at least part of the contextual information.

Abstract: A wearable apparatus is provided for capturing and processing images from an environment of a user. In one implementation, a wearable apparatus includes a transmitter, a memory, an image sensor configured to capture a stream of images from an environment of a user of the wearable apparatus, and a processing device. The processing device is programmed to receive the stream of images from the image sensor, analyze the stream of images to detect the external device in the environment of the user, and cause the transmitter to transmit an interrogation signal that is configured to cause a change in an aspect of the external device. The processing device is further programmed to analyze the stream of images to detect the change in the aspect of the external device and, after detection of the change, store in the memory information relating to the external device.

Abstract: Systems and methods for amplifying and/or attenuating audio signals are disclosed. In one implementation, a system for selectively amplifying audio signals may include at least one microphone for capturing sounds from an environment of the user and a processor. The processor may be programmed to receive an audio signal representative of sounds captured by the at least one microphone; determine whether the audio signal comprises speech by a user of the system; subject to the audio signal comprising speech by the user, modify the audio signal by attenuating a first part of the audio signal comprising the speech by the user; subject to the audio signal comprising audio other than speech by the user, modify the audio signal by amplifying a second part of the audio signal comprising audio other than the speech by the user; and transmit the modified audio signal to a hearing interface device.

Abstract: System and methods for processing audio signals are disclosed. In one implementation, a system may include a microphone configured to capture sounds from an environment of a user; and at least one processor. The processor may be programmed to receive at least one audio signal representative of the sounds captured by the microphone; transcribe at least a portion of the at least one audio signal into text; generate metadata based on the transcribed text; after receiving the at least one audio signal, receive a request for information associated with a topic; select an information source from a plurality of information sources based on the received request for information; search the selected information source for a word or phrase based on the request; and output the word or phrase for entry into a record associated with the topic.

Abstract: System and methods for processing audio signals are disclosed. In one implementation, a system may include a wearable apparatus including an image sensor to capture images from an environment of a user; an audio sensor to capture an audio signal from the environment of the user; and at least one processor. The processor may be programmed to receive the audio signal captured by the audio sensor; identify at least one segment including speech in the audio signal; receive an image including a representation of a code; analyze the code to determine whether the code is associated with the user and/or the wearable apparatus; and after determining that the code is associated with the user and/or the wearable apparatus, transmit at least one segment of the audio signal, at least one image of the plurality of images, and/or other information to a computing platform.

Abstract: The present disclosure relates to systems and methods for directing the audio output of a wearable device having a plurality of speakers. In one implementation, the system may include an image sensor configured to capture one or more images from an environment of the user of the wearable apparatus, a plurality of speakers, and at least one processing device. The at least one processing device may be configured to analyze the one or more images to determine at least one indicator of head orientation of the user of the wearable apparatus, select at least one of the plurality of speakers based on the at least one indicator of head orientation, and output the audio to the user of the wearable apparatus via the selected at least one of the plurality of speakers.

Abstract: A hearing aid system for selective modification of background noises may include at least one processor. The processor may be programmed to receive a plurality of images from an environment of a user captured by a wearable camera during a time period and receive an audio signal representative of sounds acquired by a wearable microphone during the time period. The processor may determine that at least one of the sounds was generated by a sound-emanating object in the environment of the user, but outside of a field of view of the wearable camera and retrieve from a database information associated with the sound-emanating object. Based on the retrieved information, the processor may cause selective conditioning of audio signals acquired by the wearable microphone during the time period and cause transmission of the conditioned audio signals to a hearing interface device configured to provide sounds to an ear of the user.